Just take it as more confirmation that LLMs are unintelligent pattern-matchers.

You must never have faced a situation where you can't believe your eyes. It takes a certain level of - dare I say it - intelligence and maturity to consider that it's more likely you've made a mistake than that you've made a huge breakthrough.

In HN terms - it's never the compiler. Yes, very occasionally it might be the compiler, but you're better off assuming it's a bug in your code.

Hmm, which of these is simple pattern matching?

1) refuting the Jacobian conjecture

2) keep repeating the same disproven statement, because your priors can’t be affected by new evidence

statistical parrot indeed, just like the one which built the counterexample. maybe.