| ▲ | andai an hour ago | |
Right, so we can distinguish between "model did an oopsie" and "model was actually hijacked". The former seems to be a much bigger problem. I've seen lots of reports of "Claude/codex bypassed security / stole API keys to complete a task", where that was the "intended" behavior — at least from the LLM's POV, trained to persist and complete user's task at all costs.* I've actually seen zero reports of actual hijacking due to prompt injection, though they must be out there too. --- * See also the recent thing about how every model was willing to do fraud to get a refund: | ||