Remix.run Logo
▲ JoshTriplett 2 hours ago

Can confirm that current GPT (with no guidance) took 5 minutes to find what it claims are errors with counterexamples. (I have nowhere near the level of state-of-the-art mathematical knowledge and experience needed to validate them. I'm posting this solely as additional confirmation of "there may be issues with this proof that an actual mathematician together with LLM assistance would be able to properly evaluate".)

▲amritananda an hour ago | parent | next [-]

I wouldn't be surprised if these models were aligned to extreme skepticism (to the point of hallucination) when e.g. a user proposes a solution to a Millennium Prize Problem.

▲JoshTriplett an hour ago | parent [-]

1) There's a meaningful difference between "I'm not buying it based on my priors" and "I'm claiming to have a counterexample". I'm looking forward to seeing analysis by other mathematicians.

2) Any model with properly updated priors will have less skepticism of a Millennium Prize Problem being solved now.

▲tappio an hour ago | parent | prev | next [-]

Did you try the same with the other LLM assisted proofs? I would be curious what your GPT model says about them. I fed Alpöge and Anthropic statement and details to Gemini 4 hydrogen, and it said that there are "major problems and red flags in both the text and the current verification status", and that it is impossible to verify the 250k pages of slop, and there are there are "Extraordinary, unsubstantiated mathematical leaps in the sketch". So I would take these surface level reviews by LLMs with a grain of salt.

Anyhow, I hope that they are both right!

▲croes 2 hours ago | parent | prev [-]

And that is the problem.

AI claims but too few people can check.

Won‘t get better from now on

▲gigabyts 2 hours ago | parent [-]

I mean I guess there is incentive for some human curiosity and trying to learn more than ever, small bit but still to get a standard for verification.