Nobody knows.

It's not a zero sum game. You can have AI "senior engineers" working under humans building bigger things than we've been able to.

We also don't know where the capabilities of current AIs will plateau. The benchmarks aren't really telling the entire story. From my perspective of using the models there are certain axis where they're not making a lot of progress, like being able to have large accurate context on the scale that humans can. There are other dimensions where there is still a large gap between human capabilities and LLMs. It's true that relative to other areas (lessay chess) LLMs are more generalized but they are still not fully generalized (back to the chess example, LLMs are not good at chess).

> It's not a zero sum game.

Resources are, though. The planet cannot support a race of digital super-people, and us, and an continually growing economy.

It's the height of folly to think that, as things are going, we are going anywhere "good".