If it does it will be at the hands of another human.

AI to me is like the Nuclear race again. Super powers will be using it as a super weapon. I don't think AGI will wipe us out by itself.

▲

winddude 3 hours ago | parent | next [-]

more likely an incompetent administration puts it in charge of military infrastructure and capabilities it shouldn't

▲

kortilla 3 hours ago | parent | prev | next [-]

I’m not so sure on this, the hugging face incident showed that a relatively benign task can make it do quite destructive things in the name of optimizing a relatively benign goal.

	▲	madaxe_again 3 hours ago \| parent [-]
		I think we need to worry about paperclip maximisation as much as we need to worry about “Jon is having a bad day so brews up a novel plague”. There are likely ways it can go wrong that we haven’t even considered, too.

▲

madaxe_again 3 hours ago | parent | prev | next [-]

I see it in much the same light - and the spending going into it leads me to infer that those doing the spending see the same thing.

Whoever gets to RSI first and has the compute to act on it, wins the future - assuming they don’t lose control of it.

Similarly to the nuclear arms race, Teller raised the reasonable concern that a detonation could propagate through the entirety of earth’s atmosphere. Thankfully that turned out to not be true, but the parallel is that the need/desire to win this race is similarly strong, and the brinkmanship and game theory in play is effectively identical.

▲

georgemcbay 3 hours ago | parent | prev [-]

> AI to me is like the Nuclear race again

I don't pretend to know the chances of AI wiping out humanity, but I'm not sure the nuclear race is a good comparison.

Enriched uranium being very difficult to aquire/process makes it practically viable to have some level of proliferation containment when it comes to nukes.

There appears to be no such natural gating factor on AI proliferation.