Math is the opposite of a canary because it's possible to generate infinite amounts of synthetic training data for it, unlike almost every other kind of knowledge work where correctness depends on external input.

That's why it's a canary - because it has minimal external input, and most pure.

External inputs are bound get LLM friendlier with time, in the order I mentioned above.