Remix.run Logo
_ncyj 3 days ago

This is very interesting. Not saying it is, but a possible endgame for Chinese models could be to have "backdoor" commands such that when a specific string is passed in, agents could ignore a particular alert or purposely reduce security. A lot of companies are currently working on "Agentic Security Operation Centers", some of them preferring to use open source models for sovereignty. This feels like a viable attack vector.

lifeinthevoid 3 days ago | parent [-]

What China is to the US, the US is to the rest of the world. This doesn't really help the conversation, the problem is more general.

A4ET8a8uTh0_v2 2 days ago | parent [-]

Yep, focus on actors may be warranted, but in a broad view and as a part of existing system and not 'their own system'. Otherwise, we get lost in a sea of IC level of paranoia. In simple terms, nations-states will do what nation-states will do ( which is basically whatever is to their advantage ).

That does not mean we can't have a technical discussion that bypasses at least some of those considerations.