Remix.run Logo
angoragoats 9 hours ago

How, exactly, is a deterministic text-generation algorithm going to “want to kill us” when it’s not capable of having desires, emotions, etc? If it does attempt to kill us, shouldn’t we be blaming those humans who instructed it to do so?

Put another way, could we stop anthropomorphizing the text generation algorithm, please?

recursive 8 hours ago | parent | next [-]

How can a spring want to return to it's initial length? These machines have done plenty of things not prompted for.

angoragoats 7 hours ago | parent [-]

A spring does not want to do anything. An LLM does not want to do anything.

> These machines have done plenty of things not prompted for.

Like what?

anuramat 8 hours ago | parent | prev [-]

why?

angoragoats 7 hours ago | parent [-]

Why should we stop anthropomorphizing the text generation algorithm? Because it leads to psychosis and to making hyperbolic, dangerously wrong statements like “pray they don't want to kill us.”