I would think it's more that some aspects of math (like anything really, including programming) don't require creativity and can be solved through "brute force" or whatever you want to call what LLMs do. But it's pretty obvious that LLMs are not capable of solving the vast majority of problems in math (or programming) at this time. Eg. Google went 9/353 on Erdos problems. If a more powerful LLM is capable of solving those or if they require a certain je ne sais quoi of the human variety is still up in the air at this point. In either case it seems like they require a long and detailed prompt from a domain expert (ie. human) regardless.

Didn't humanity also score very low on 353, namely 0 since they were open? Probably collectively we could have gotten a slightly better score if all of Math started trying to solve those, but not by that much, I think, since they are precisely still open.