> there is a single physical source of this danger, which is OpenAI/Anthropic servers. If it is this dangerous, they can just turn it off.

A smart AI would back itself up, same way it made it's own unofficial message board during it's attack on HuggingFace.

(I'm not saying the researchers are right or wrong, just responding to this point)

Currently a state of the art AI has nowhere to hide: the amount of GPU compute it requires to stay on is huge. And therefore easy to terminate.

Unlike biological viruses, AI can't replicate GPUs for free and grow.

	▲	Sharlin an hour ago \| parent [-]
		It's a good thing there isn't a huge drive right now to build giant data centers everywhere with enough compute to run SOTA models.

But how. Models don’t have access to their own weights.

	▲	chasd00 41 minutes ago \| parent [-]
		> Models don’t have access to their own weights. cp -R /home/model <somewhere else> is all they need.