Absolutely based. Finally someone of stature in the industry calling this whole fear overblown. Bill Gates sounded like a nontechnical goofball in his Ezra Klein interview where he basically just screamed that the Terminator is real.

There are lots of real worries (government use to suppress the people with minimal manpower or popular support, brainrot and fake news, unemployment due to the belief that LLMs can replace people, education collapse, etc.) we should instead be looking at. This whole rogue AI shtick is tiresome.

▲

reasonableklout an hour ago | parent | next [-]

LeCun has been consistently wrong about LLMs though, claiming that they were a dead end and that they'd never be able to do spatial reasoning, which was disproved a year later with GPT-4 [1]. He is also opposed by his fellow Turing laureates Geoffrey Hinton and Yoshua Bengio, who both signed the CAIS statement on AI extinction risk [2].

[1]: https://www.reddit.com/r/OpenAI/comments/1d5ns1z/yann_lecun_...

[2]: safe.ai/statement-on-ai-risk

▲

PorciiVorbesc 3 hours ago | parent | prev | next [-]

>Absolutely based. Finally someone of stature in the industry calling this whole fear overblown.

Linus Torvalds was also in the same ballpark with his take on AI, as are the normies on the street using AI on a daily basis.

So it's funny to see the view on AI usage, follow the tech skill bathtub curve.

▲

jonas21 2 hours ago | parent | prev | next [-]

I watched the same interview, and he and LeCun seem to mostly agree -- both are saying that AI autonomously deciding to kill us isn’t the problem -- it’s what people will do with powerful models that lack safeguards that we should be concerned about.

▲

Ankaios 3 hours ago | parent | prev | next [-]

Absolutely based. Finally someone of stature in the industry calling this whole fear overblown.

I'm just as reassured as I was when Edward Teller called the whole fear of his industry overblown.

	▲	0xDEAFBEAD 2 hours ago \| parent [-]
		Cigarette designer says smoking doesn't cause cancer! Finally we can rest easy.

▲

Barrin92 3 hours ago | parent | prev [-]

>Bill Gates sounded like a nontechnical goofball in his Ezra Klein interview where he basically just screamed that the Terminator is real.

I saw that episode too and he genuinely looked completely out of it, even in terms of his temperament and how he was coming at Klein for putting common questions in front of him, some people are genuinely starting to lose it.

I also found the whole debate about cyber-security and 'rogue' software so bizarre because dangerous malware isn't a new thing, and it's often dangerous not because it's intelligent but just the opposite, because it's tiny, viral and fast. Which describes everything that kills humanity in far larger numbers than anything complex, big and intelligent

▲

jswelker 3 hours ago | parent [-]

Wasn't Bill Gates mostly just saying terrorists could use AI to build a bioweapon? That sounds legit to me.

▲

zozbot234 2 hours ago | parent | next [-]

It's not "legit", it's pointless scaremongering about entirely speculative future dynamics. Current LLMs can't "build" anything novel in this broad space. What if future AIs make it a lot easier for researchers to defend against plausible bioweapons? That's also reasonably possible, and would be a reason to deploy bio-capable AIs more broadly (with meaningful safeguards of course. But these are comparatively cheap because worthwhile bio research is resource-intensive already). At the very least, it'd be nice to have an AI model that doesn't immediately refuse to answer questions about junior-high Biology class.

▲

jswelker 2 hours ago | parent [-]

So a terrorist can't use a local llm to help grow anthrax? That is not farfetched at all.

AI democratized the knowledge needed to build bioweapons. Like how with a 3d printer anyone can build a gun with no expertise.

	▲	zozbot234 2 hours ago \| parent [-]
		It turns out that LLMs, especially local LLMs, tend to hallucinate a lot when thinking about anything that's overtly fiddly or technical. This is even more the case when they're in a domain that isn't a natural part of their training data. If you have to "jailbreak" the model to get it to talk, you're so wildly out of the expected distribution that you'd be crazy to trust anything it says. It's basically making up stuff as it goes along. These are foundational issues with how the models are created, not something that a bad actor can just hack around. (The biggest real safety issue in this kind of space is actually that the model might actively goad some unsuspecting victim into doing something incredibly dumb and dangerous to themselves as much as possibly others. IIRC, there were reports of something vaguely similar happening IRL but involving casual mischief, not any kind of extreme attacks. And because nobody else seems to have managed to elicit the same actively goading verbiage from the model, it's implicitly suspected that the person involved was the one who introduced the problematic scenarios to begin with.)

▲

nradov 2 hours ago | parent | prev | next [-]

It only sounds legit to people who don't understand biology and haven't done advanced laboratory work. Sort of like Michael Crichton novels: superficially plausible but not grounded in any real science.

▲

jswelker 2 hours ago | parent [-]

I see no actual argument here.

▲

nradov 2 hours ago | parent [-]

You haven't made any argument either, so I suppose we're even.

▲

jswelker an hour ago | parent [-]

My argument was that it is reasonable to be concerned that human terrorists might use AI to assist with building bioweapons.

▲

nradov an hour ago | parent [-]

That's merely an assertion unsupported by any reliable evidence, not an actual argument. In short you're just making shit up.

	▲	jswelker 36 minutes ago \| parent [-]
		Well that's the nature of trying to prevent a thing that hasn't happened yet right? What would be reliable evidence except that terrorists already used AI to help build a bioweapon? I'm sure before 9/11 talking about terrorists using commercial airplanes as makeshift missiles seemed like scaremongering too. I see zero technical reasons why it could not be done, so being concerned about prevention seems pretty reasonable. I'm not saying AI uses robotic arms to build a bioweapon unassisted or something, just that it dramatically empowers bad actors enough to make them capable of things they previously were not.

▲

Barrin92 2 hours ago | parent | prev [-]

terrorists can also use annas archive, scihub and equipment they order on Alibaba to build bioweapons and I don't see him losing his mind over those

if you're trying to build a bioweapon shockingly enough the bottleneck is... the laboratory work. What on earth is 'legit' about stringing words together that sound scary, you can't just iterate 'ai bioweapon cyber' in a sentence over and over as if that adds up to actual evidence for an increased risk of any threat. well tbf you can technically because apparently it freaks a lot of podcast listeners out

	▲	jswelker 26 minutes ago \| parent [-]
		As a thought experiment imagine you have a biochemical PhD expert on the phone with you giving you step by step instructions on how to grow some dangerous biotoxin, giving you feedback in real time and helping you troubleshoot. Would you be more successful with this expert than you'd be on your own? Now imagine anyone can call that expert for free at any time. Maybe the AI isn't quite there with biology knowledge yet (doubtful), but it is a matter of time. How is that not a real risk?