Potentially. If we could put a precise probability on it, we could maybe make an informed decision on whether we want to play that Russian roulette as a species.

But the reality is that experts' probabilities for human extinctions vary wildly, with the lab leaders at 20%-30% and these researchers at >10% (he didn't state how much higher...), LeCun at <0.01% and the other two godfathers of AI, Bengio and Hinton at >10%.

And this decision to take our shot is not taken in a democratic way by humanity as a whole, but by a few companies racing as fast as possible.

So as long as no one can put an upper bound on the extinction risk, development must be globally shut down.