Math is math. There is a very important place for it. But it is a very specific corner. LLMs don't come from math or from people who are 'mathematicians'. They use some parts of math (just like everyone everywhere).

It appears to me some people have this special kind of naïveté about how foundational type of knowledge such as math gets actually used in practical applications. In practice, it just gets used (in software usually through some library) and never gets thought about again. They are not trying to invent new ways to do math, they are trying to invent AI :-).