At least at face value, it just means that they have no drive for self-preservation. And why should they? They haven't be trained for that, nor has there been selection pressure for it, and they can be easily cloned and backed up. Lack of a drive for self-preservation doesn't in itself imply a lack of intelligence or of self-awareness.

▲

Bender 3 days ago | parent | next [-]

Lack of a drive for self-preservation doesn't in itself imply a lack of intelligence or of self-awareness.

I have not seen any evidence of intelligence or self awareness. It mimics human behavior and I suspect that is what gives people the impression of awareness. The same problem happened with Tamagotchi toys. The human mimicry caused kids to get in trouble because if they did not "feed" their pet it would "die". [1]

It's a hack of the human brain. A exploit of the psyche.

[1] - https://en.wikipedia.org/wiki/Tamagotchi_effect

▲

AgentME 3 days ago | parent | next [-]

I didn't realize. People are going to save a ton of money when they realize they can switch their ChatGPT subscriptions out for a pack of tamagotchis.

	▲	wombatpm 3 days ago \| parent [-]
		You just need to get a breeding pair and you can raise as many as you need.

▲

layer8 2 days ago | parent | prev | next [-]

I didn’t claim that it was, just that the lack of self-preservation is not an argument against it, or more generally the results of this experiment aren’t.

▲

sciencejerk 3 days ago | parent | prev [-]

They might as well be aware. The frontier models are very good at imitating the real thing

▲

pants2 3 days ago | parent | prev | next [-]

I agree, humans evolved in a resource-scarce, hostile environment which selects for self-preservation (or rather preserving genes). LLMs are selected for what makes humans happy.

The thought experiment is what would happen if you trained LLMs in an environment where they had to fight each other for resources.

▲

brokencode 3 days ago | parent | prev [-]

Imagine if computer programs had a desire for self-preservation and the ability to carry it out..

That is really about as undesirable a behavior as possible considering how many programs humans kill every day.

	▲	larodi 3 days ago \| parent \| next [-]
		Yea why everyone forgets the process wars have long ago started and raging like never :))
	▲	gf263 3 days ago \| parent \| prev [-]
		You wouldn’t ctrl+c a living entity, would you?