OH MAN I almost forgot.

We’ve had a few of these stem from custom LLM agents. The most hilarious one we’ve seen was one that you could get to print its instructions pretty easily. In the instructions was a bit about “DON’T TALK ABOUT FILES LABELED X”.

No guardrails other than that. A little creative prompting got it to dump all files labeled X.