> The fundamental challenge in AI for the next 20 years is avoiding extinction.

That's a weird thing to end on. Surely it's worth more than one sentence if you're serious about it? As it stands, it feels a bit like the fearmongering Big Tech CEOs use to drive up the AI stocks.

If AI is really that powerful and I should care about it, I'd rather hear about it without the scare tactics.

▲ Recursing 2 days ago | parent | next [-]

I think https://en.wikipedia.org/wiki/Existential_risk_from_artifici... has much better arguments than the LessWrong sources in other comments, and they weren't written by Big Tech CEOs.

Also "my product will kill you and everyone you care about" is not as great a marketing strategy as you seem to imply, and Big Tech CEOs are not talking about risks anymore. They currently say things like "we'll all be so rich that we won't need to work and we will have to find meaning without jobs"

▲ tejohnso 2 days ago | parent | prev | next [-]

What makes it a scare tactic? There are other areas in which extinction is a serious concern and people don't behave as though it's all that scary or important. It's just a banal fact. And for all of the extinction threats, AI included, it's very easy to find plenty of deep dive commentary if you care.

▲ grodriguez100 2 days ago | parent | prev | next [-]

I would say yes, everyone should care about it.

There is plenty of material on the topic. See for example https://ai-2027.com/ or https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a...

▲ emp17344 2 days ago | parent | next [-]

The fact that people here take AI 2027 seriously is embarrassing. The authors are already beginning to walk back these claims: https://x.com/eli_lifland/status/1992004724841906392?s=20

	▲	a day ago \| parent [-]
		[deleted]

▲ jowea a day ago | parent | prev | next [-]

And I thought the rest of the thread was anxiety-inducing. Thanks for the nightmares lol.

▲ dkdcio 2 days ago | parent | prev [-]

fear mongering science fiction, you may as well cite Dune or Terminator

▲ defrost 2 days ago | parent | next [-]

There's arguably more dread and quiet constrained horror in With Folded Hands ... (1947)

  Despite the humanoids' benign appearance and mission, Underhill soon realizes that, in the name of their Prime Directive, the mechanicals have essentially taken over every aspect of human life.

  No humans may engage in any behavior that might endanger them, and every human action is carefully scrutinized. Suicide is prohibited. Humans who resist the Prime Directive are taken away and lobotomized, so that they may live happily under the direction of the humanoids.

~ https://en.wikipedia.org/wiki/With_Folded_Hands_...

▲

XorNot 2 days ago | parent [-]

This hardly disproves the point: no one is taking this topic seriously. They're just making up a hostile scenario from science fiction and declaring that's what'll happen.

	▲	2 days ago \| parent [-]
		[deleted]

▲ lm28469 2 days ago | parent | prev [-]

Lesswrong looks like a forum full of terminally online neckbeards who discovered philosophy 48 hours ago, you can dismiss most of what you read there don't worry

	▲	timmytokyo 2 days ago \| parent [-]
		If only they had discovered philosophy. Instead they NIH their own philosophy, falling into the same ditches real philosophers climbed out of centuries ago.

▲ dist-epoch 2 days ago | parent | prev | next [-]

Yeah, well known marketing trick that Big Companies do.

Oil companies: we are causing global warming with all this carbon emissions, are you scared yet? so buy our stock

Pharma companies: our drugs are unsafe, full of side effects, and kill a lot of people, are you scared yet? so buy our stock

Software companies: our software is full of bugs, will corrupt your files and make you lose money, are you scared yet? so buy our stock

Classic marketing tactics, very effective.

▲ VladimirGolovin 2 days ago | parent | prev [-]

This has been well discussed before, for example in this book: https://ifanyonebuildsit.com/