But why can’t we prompt the LLM “just do math research”? This is what I don’t understand.

If there aren't thousands of TPUs doing that [0] right now I'd be quite surprised.

[0]: e.g. "go through wikipedia's unsolved math problem list and solve them".