Remix.run Logo
tintor 6 days ago

It is not sufficient to secure VM the agent has CLI permissions on.

We must also secure GPU and CPU nodes on API side which generate LLM tokens.

hikarudo 6 days ago | parent [-]

Why? The inference server isn't a harness, it's tokens in, tokens out. That's different from a harness.

pixl97 6 days ago | parent [-]

While hacking the inference server via tokens seems unlikely I still remember the days that "images can't hack you" so there's that.