Can you come up with a concrete prediction on what AI can’t do in math? Something testable.

Yes, here is a concrete prediction

AI will not replace the mathematical community (peer review, abstraction creation) until AI can train the next AI purely on data generated by itself and with a tool in a turing complete environment. The environment has to be air-gapped from human data but the AI can use tools and its own outputs

I think that "solving math" is isomorphic to solving the "thinking part" of the scientific process which would be genuine RSI