I'm starting to think that AI development might be the great filter. There are so many levels of competition at play here and even if an agreement is reached to slow everything down, the incentive is to cheat at that. I really don't think there's much of a chance we have control over the situation, we're just gonna summon these things and all we can do is pray they don't want to kill us.

▲

layer8 10 hours ago | parent | next [-]

This is what people were saying about nuclear technology half a century ago.

	▲	wk_end 10 hours ago \| parent [-]
		And? Nuclear technology continues to be an excellent candidate for the Great Filter.

▲

angoragoats 9 hours ago | parent | prev [-]

How, exactly, is a deterministic text-generation algorithm going to “want to kill us” when it’s not capable of having desires, emotions, etc? If it does attempt to kill us, shouldn’t we be blaming those humans who instructed it to do so?

Put another way, could we stop anthropomorphizing the text generation algorithm, please?

▲

recursive 8 hours ago | parent | next [-]

How can a spring want to return to it's initial length? These machines have done plenty of things not prompted for.

	▲	angoragoats 7 hours ago \| parent [-]
		A spring does not want to do anything. An LLM does not want to do anything. > These machines have done plenty of things not prompted for. Like what?

▲

anuramat 8 hours ago | parent | prev [-]

why?

	▲	angoragoats 7 hours ago \| parent [-]
		Why should we stop anthropomorphizing the text generation algorithm? Because it leads to psychosis and to making hyperbolic, dangerously wrong statements like “pray they don't want to kill us.”