Some years ago I came across this site: https://sites.google.com/site/1024cores

The author is a developer working on software that scales to 1,024 cores and greater -- which is within spitting distance now thanks to 256-core AMD EPYC processors. If you count hyperthreads as a "virtual core" then a dual-socket system gets you there!

That blog made me realise that almost all software can't utilise 1,024 cores, not even close! Microsoft SQL Server, as a random example, tops out at 64 cores for any single query.

Similarly, people couldn't utilise a machine that big, not with pre-AI software, except for certain embarrassingly parallel codes such as simulations and 3D graphics rendering.

Now... NOW... there's no upper limit. None. One person(!) can cheerfully utilise millions of cores, billions even, and there's no end in sight.

If you think one conversation thread in "ChatGPT" is all we need, you're not seeing the big picture of what's possible here.

Those math proofs OpenAI produced were created with tens of thousands of agents running in parallel, orchestrated by thousands more agents, and overseen by hundreds of agents, all triggered by someone typing as little as a sentence or two to start that avalanche of compute!

With that kind of AI power at your fingertips, huge, unthinkable projects become a fun exercise for the weekend:

- Translate the entirety of Wikipedia to every human language.

- Rewrite the entire Linux kernel to Rust in one go

- Rewrite all open source C code to Rust.

- Formalise every maths paper ever written.

Etc, etc, ... without end, without bound.