>“Given today’s risks, frontier labs need to run like nuclear-power plants or busy airports, with layers of redundancy and careful, time-consuming planning, so that the occasional and inevitable human error does not open a door to disaster,” he wrote.

This sounds more like an attempt at regulatory capture. Current AI systems aren't physical infrastructure that can just run away like a nuclear power plant, for example. At the end of the day, AI is still just software running on someone's hardware.

So… like the Therac-25 radiation accidents? Software bugs do sometimes have physical consequences.

Why would the people who quit these companies try to push regulatory capture by said companies? Why would the numerous independent AI researchers do that either? Is it all a big conspiracy?

I mean, its certainly physical infrastructure that can run away. Just less catastrophic than nuclear reactors

Yes

And the statements of the "doomers" tells us a lot about them, and nothing about the technology