I think the idea is that AI itself is going to massively accelerate its own development, and AI with real-world competence is coming very soon. At the rate things are going, it wouldn't suprise me at all if we had mass production of AI-designed systems in the next six months, actually.

Sup fellow Alex.

> AI with real-world competence is coming very soon

Disagree, Moravec's Paradox remains undefeated. How long has Elon promised self-driving cars? Or how long have we been seeing humanoid-robot-walking demos? Laundry folding demos?

Let's assume that a magical AI powered robot hand lands tomorrow. How long do you think it'll take to ramp up assembly/production/distribution/sourcing/materials/QA for, say, a million of them? Never mind the legal/integration/maintenance time.

And even once those have landed, and assuming they are ALL put to work on iterating on research testing to build out super-high-capacity-drone-batteries, how long do you think it would take for that to evolve into killer-insect-drones? BTW you should know that even though high capacity silicon carbon batteries exist, they haven't supplanted other Li-ion batteries for a host of reasons. A million things stand between a technology working in a lab and surviving the real world.

And during this entire process, the (geo)political/social/legal process will be churning away, changing the societal landscape in which the killer-robots land. Not to mention that mechanistic interpretability is (likely) somewhat grindable. A lab just needs to dump a billion dollars of compute into it after it declares AGI.

I'm unconvinced we get killer insect drones before we crack mech-interp.

And even once we get killer insect drones, they need to somehow have no kill-switch and then literally exterminate everyone on the globe? Can you see why I have a problem with doomers predicting human extinction within the decade?

I'm putting words in your mouth and not replying to precisely what you said, just the general vibe. LMK if I overstepped.

P.S. we do have mass production of AI designed systems today e.g. https://en.wikipedia.org/wiki/Evolved_antenna There's nuance to this whole thing.