| ▲ | tintor 6 days ago | |||||||
It is not sufficient to secure VM the agent has CLI permissions on. We must also secure GPU and CPU nodes on API side which generate LLM tokens. | ||||||||
| ▲ | hikarudo 6 days ago | parent [-] | |||||||
Why? The inference server isn't a harness, it's tokens in, tokens out. That's different from a harness. | ||||||||
| ||||||||