Remix.run Logo
▲ epistasis 3 hours ago

The only attacks possible would be the tools given to the agent.

▲swiftcoder 2 hours ago | parent [-]

Assuming it can't perform a sandbox escape, at any rate. Maybe a Jev-like decision model would be a better idea.

▲epistasis 32 minutes ago | parent [-]

Or just don't allow tools, write a simple python script that uses the API and doesn't do tool calls, etc. etc. etc.

Table stakes for being an engineer these days should include knowing how to control LLMs, it's as fundamental as a working knowledge of databases. One doesn't need to know how design a data model from scratch or code up that python script using the OpenAI API from memory, but should know the general shape of what's possible and how to look it up.