Remix.run Logo
▲ simonw 7 hours ago

My intuition is that the models from this year are really hard to successfully inject.

The labs have been pouring a ton of energy into training against these attacks, as hinted from their system cards.

Doesn't mean they can't be beaten, but you likely need a whole lot more context than a short HTTP header to do it.

▲kingcauchy 34 minutes ago | parent [-]

It would be very surprising if they weren't working on even more long-context injection, an agent these days could very easily have a single http call get the markdown/http for a whole page that's essentially injection/propaganda. It seems like the agents have been trained on wrapping responses in tails/cats from `.log` calls or other tool calls, in which case the model training will implicitly be trained on the trustworthiness of context within the tool call tokens.