I guess the issue is -

To advance math you need people who could be really high earners in any other field and stuck to math mainly because they find it intrinsically motivating.

You change the calculus for motivation you potentially devastate a generation of talent who just decide to go to wallstreet or something since it seems there is no longer fun to be had in maths.

It actually _is_ about individual motivation.

AI:s are not mature enough to have any sort of institutional framework built around them.

So removing a generation of mathematicians is institutionally destructive and since the field seems to have tacit elements - you teacher and the student to discuss things in same room - this is not just about labour but continuity of capability.

I mean that's how I understand the alarm. I don't do maths so I can't argue for or against.

AI:s are amnesiacs. Even with 1M context they struggle really hard to understand architecture of complex software application.

So you can't really use them as only cognitive building blocks for complex novel systems design and engineering.

I believe the same analogue probably applies to maths.