Sure. But either way we aren’t going to have to worry about it. We’ll have post scarcity utopia, or we’ll have died. But there is an argument that the billionaire need to pay attention to: an ASI that kills 7 billion people won’t mind killing a few more.

What happens in the space between when we think we have reached an equilibrium and an eventual incipient utopia, and whenever 9/10ths or whatever of the population is dead? What will AIs think of our fitness, anyway? Are we training them to be non-judgmental (and how is that safer or less safe?) and enforcing some weird idea of "equality"? Or are we teaching AIs to choose our choices for us, and our survivors, down the line? What will people be like when that time comes, anyway?