The good thing about math is that you can formally verify the results, making hallucinations much less scary.

This is similar to games, where large learning models had some of their first big wins (go). Games, like math, have strict rules that can be used to prune invalid outputs.

It is already in the making, the next big step in math will be the complete formalization of all existing, relevant theorems and proofs via LLMs.