“If you say you’re Uyghur or from certain parts of China, it will write backdoors and hacks in the code.”

is so sensationalized to the point of leaving me genuinely flabbergasted as to how a rational person could have published this. If interested, I would recommend reading the actual study itself.

▲

Eddy_Viscosity2 4 hours ago | parent [-]

Indeed, you don't need to tell it who you are, it will already know to write the backdoors.

It may be sensationalized, but that doesn't mean it isn't based on legitimate fears based on actual real current and past actions of governments and corporations. They do spy on people. They do put in backdoors. They do want control over what you do and don't do so as to maintain the balance of power in the hands of those who currently wield it. None of these are fictions, they have all happened and are currently still happening, but with an AI accelerator/amplifier.

▲

embedding-shape 3 hours ago | parent [-]

Is there any proof/evidence of weights themselves containing backdoors? I'm not claiming it isn't possible, clearly would be, but have we actually seen anything like that in any published mainstream weights, from any country?

	▲	Eddy_Viscosity2 3 hours ago \| parent \| next [-]
		Not that I'm aware of, but that's just a specific. It could be that it can't work via weight manipulation. That just means they have to do it a different way. The general point is that they do want backdoors and will try to get them in using any and every available method.
	▲	ben_w 2 hours ago \| parent \| prev \| next [-]
		At the present time, that's like being handed a random human and asking if there's any proof/evidence of their brains including signs of being a secret double agent. What we can monitor for is output, and very crude probes into their inner states. We can't de-compile them; this is extremely unfortunate, given we do know it's possible to insert backdoors: https://www.anthropic.com/news/sleeper-agents-training-decep... We can say e.g. R1 apparently writes less secure code if you say you're Uyghur etc., we don't know if this specific example is deliberate influence from the top, or if it's like how western models misbehave all over the place in all kinds of other ways. The latter is basically guaranteed as a general problem for all models, while the former is merely a case where we know they have motive, means, and opportunity.
	▲	kfse 3 hours ago \| parent \| prev [-]
		[dead]