Lets say you don't leave it unencrypted on disk, only in memory. Do you really think vps providers are slurping your personal data out of a VM's memory in the same way google do dragnet personal data gathering? If your adversary is the government, sure they probably can do that, but otherwise it seems unlikely.