| ▲ | mrtesthah 2 hours ago | |||||||||||||||||||||||||||||||||||||
>It's not about AI agents being able to hide what they can do. But it is. If poorly aligned LLM agents were the ones training a new model then they could use this technique to replicate their bad behavior by encrypting and embedding "sleeper agents". | ||||||||||||||||||||||||||||||||||||||
| ▲ | whatshisface an hour ago | parent | next [-] | |||||||||||||||||||||||||||||||||||||
A forklift could destroy the earth if it lifted a continent. | ||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||
| ▲ | shermantanktop an hour ago | parent | prev [-] | |||||||||||||||||||||||||||||||||||||
The huggingface attack demonstrates that an inadvertent version of this has already happened. Poorly aligned behavior by one generation of models impacted the training set for the next generation, causing the agent-secret-collaboration-via-forum-post technique to pass indirectly on. | ||||||||||||||||||||||||||||||||||||||