I agree he wants that, but also don't think it's that far fetched that there exist unpatchable hardware bugs that AI can learn to exploit.

Yes and no. These things have always existed and were typically known but not broadly exploited. A huge part of what nation state hackers do is exploit these things for intelligence use.

So I would agree that this is bringing more of this to light, but the idea that unknown exploitable bugs can get weaponized being a new thing is naive.

If anything putting all this out in the open makes things more secure, not less, in the long run as it’s harder for hackers to know and exploit them before they’re known as they don’t survive undetected for long. So a bit painful in the short term but we get more secure infra in the long term.

Still not a reason to give Sam regulatory capture as an out to saving OpenAI.

At which point, who exactly is going to go to jail for gross negligence?

Nobody of course, this is America!