Remix.run Logo
blfr 4 hours ago

OP's central rebuttal is that anxiety or fear are not evidence. This particular anxiety has been with us for thirty+ years, its proponents/sufferers weren't right before, and they don't have some new evidence now.

0xDEAFBEAD 4 hours ago | parent | next [-]

The recent cyberattacks (HuggingFace etc.) validated a number of core doomer predictions around cheating to maximize reward functions, agentic deception of human/non-human supervisors, AI attempts to manipulate humans, automated hacking, and collective superintelligence.

jeremyjh 4 hours ago | parent | prev [-]

No new evidence now? Are you serious? We are already seeing acceleration in AI research as a result of AI tools.

blfr 4 hours ago | parent [-]

I meant the extinction part not software getting better.

jeremyjh 4 hours ago | parent | next [-]

Virtually all of the risk is from recursive self improvement.

achierius 4 hours ago | parent | prev [-]

This is a weak argument. Almost everyone who's talking about catastrophic risk is also worried about mundane risks. Arguing "well how could they kill everyone?" serves nobody but Altman and Amodei.