Came here to also respond to that specific thing. Unless ai figures out how to make an airborne super virus from grocery store ingredients and hardware store equipment, the greatest danger is probably in a synchronized megahack of banking, logistics, and utility infrastructure.

Why grocery store ingredients and hardware store equipment? It seems feasible that the big bio labs will be running AI models to aid a lot of their research going forward, if they aren't already. Seems like the AI will have access to just about anything it wants.

oh so “all” it can do is bring down all banking and critical infrastructure services, no big deal really

"CDC announces a new partnership with blabalbalbal-AI to secure bioweapon stores...."

World ends.