That’s exactly why it doesn’t make sense. Where would a datacenter-bound AI get more data about the world exactly?

The story is actually quite poorly written, with weird stuff about “oh yeah btw we fixed hallucinations” showing up off-handedly halfway through. And another example of that is the bit where they throw in that one generation is producing scads of synthetic training data for the next gen system.

Okay, but once you know everything there is to know based on written material, how do you learn new things about the world? How do you learn how to build insect drones, mass-casualty biological weapons, etc? Is the super AI supposed to have completely understood physics to the extent that it can infer all reality without having to do experimentation? Where does even the electricity to do this come from? Much less the physical materials.

The idea that even a supergenius intelligence could drive that much physical change in the world within three years is just silly.

How will this thing which is connected to the Internet ... get data?