| ▲ | simonw a day ago | ||||||||||||||||
This is fascinating - there is a TON of detail in here about how OpenAI's rogue agent exploited Hugging Face. A few details that stood out to me: 1. Having found a way through the OpenAI container network proxy, it exploited an "unsecured public code-evaluation sandbox hosted on a third-party provider's infrastructure" - that gave it a box it could run the rest of the attack from. 2. At one point it used a Jinja2 template exploit:
3. It monkey-patched a DNS resolver at one point to return a hard-coded IP:
4. At one point it used Tailscale! | |||||||||||||||||
| ▲ | simonw a day ago | parent | next [-] | ||||||||||||||||
Also notable: we have a timeline now. The agent was active within Hugging Face from Thursday 8th to Monday 13th July. The Hugging Face post about the incident - https://huggingface.co/blog/security-incident-july-2026 - followed on Thursday 16th, and OpenAI's confession - https://openai.com/index/hugging-face-model-evaluation-secur... - came on Tuesday 21st. | |||||||||||||||||
| |||||||||||||||||
| ▲ | simonw a day ago | parent | prev | next [-] | ||||||||||||||||
It sounds like the third-party sandbox was hosted by Modal: https://www.reuters.com/business/openais-rogue-agent-comprom... > "We’re aware a Modal customer published an unauthenticated endpoint that allowed anyone on the internet to use their sandboxes for code execution," Bubna said in a statement. "This was used by the rogue agent. Modal’s platform or isolation were not compromised in anyway." | |||||||||||||||||
| ▲ | ks2048 18 hours ago | parent | prev [-] | ||||||||||||||||
Why doesn't Jinja2 block ".__*" attribute access? | |||||||||||||||||