Now that you mention it, why don't we encrypt injectable data that comes from users and only decrypt it on the client?

The issue is that certain questions may genuinely require the LLM to have the raw descriptions. For example, "List my grocery store transactions".

You mean, use encryption (+base64 or something) as a "poor man's" string-escape? Interesting idea!