One thing that concerns me from all this is "understanding" is very important to human progress. The fact it took 400 years to crack Fermat's theorem resulted in a lot of "Side Quests". These side quests helped grow other fields (for instance elliptical cryptography). Im concerned with AI that we will loose these side quests.

I do neither maths nor science with AI but in my experience most models are perfectly willing to burn tokens on a ton of sidequests at the earliest opportunity.