is this caching of copied data encrypted at all?

Yeah, I do wonder how this works for those copying keys and other private strings around. I'd rather they disappear on the next ^c than be pushed into an array somewhere, or worse, stored on disk.

It is if you use full-disk-encryption which is highly recommended.