> The point is that AI will be able to advance on any problem better than any human.

Define "better".

Define "advance"!

LLM agents are perfectly capable of "advancing" my codebase down bizarre, esoteric rabbitholes. Meanwhile, the value remains undelivered.

Many crystals, likewise, are advancing their fantastic complexities in the deep, dark recesses beneath the crust of the earth, but does it make a sound? Who gives a shit.

Many paperclips, indeed, can be churned out. Even we can be converted into paperclips, remember.

All but a negligible amount of novel mathematical results going forward will have had substantial LLM involvement