| ▲ | xianshou 6 hours ago |
| This is Levent Alpöge (https://en.wikipedia.org/wiki/Levent_Alp%C3%B6ge), a supremely qualified mathematician and one of the best in the world at guiding AI towards new discoveries in mathematics. If he says he has Riemann, well then, he has Riemann. |
|
| ▲ | simonw 5 hours ago | parent | next [-] |
| Levent was one of the two mathematicians working on Navier–Stokes when OpenAI published their work on that problem - which was produced in a rush when they heard a rumor that someone from Anthropic had promising results on a millenium prize problem. |
| |
| ▲ | teekert 5 hours ago | parent | next [-] | | I think he worked together with this person? https://www.youtube.com/watch?v=Mzbtj5nkMXI Pretty crazy interview, he didn't want throw the Anthropic employee under the bus when OpenAI offered co-authorship on the Navier Stokes paper. He suspects OpenAI somehow used his codex usage btw. Almost unprovable of course. | | |
| ▲ | irthomasthomas 4 hours ago | parent | next [-] | | Choice quotes from my notes on the affair: To: Buckmaster
From: A friend at OpenAI
Subject: Openai is about to do something really stupid.
"I said that if OpenAI released its result in the way proposed I would go public with what happened. The reply was, 'Why would you ruin your career?' I replied that I am an academic, and asked why he thought going public would ruin my career. The reply was, 'If you don't want me to be nice, then I don't have to be nice.'" (Sébastien Bubeck later apologized on X for the remark.)
"Sebastien twice asserted that he wanted Levent removed from authorship..."
"The second was that, after posting Euler, I alone write a paper presenting the Navier-Stokes result, acknowledging that an internal OpenAI model had resolved it.""I asked whether the model had been trained on, or had access to, our sessions in Codex, into which we had been putting all our drafts for the whole of this project. I was told the model did not look up user data. I asked again, about training, and I did not get an answer."
(OpenAI subsequently stated publicly that while unlikely, it could not rule out that de-identified data from their product usage improved the model.) | | |
| ▲ | zelphirkalt an hour ago | parent | next [-] | | "While unlikely ... it could not be ruled out ..." So basically he hit the nail on the head and they want to lie about it without lying. Either that, or they are supremely incompetent, not knowing even what they ingest into their models. Both are very much not inspiring any faith in their trustworthiness. | |
| ▲ | keeda 3 hours ago | parent | prev [-] | | In broader context the “being nice” part seems like both of them talking past each other. What happened was the two researchers, Buckmaster and Alpoge (from TFA) solved a significant subset of Navier Stokes (referenced as “Euler”) which set off rumors. Through whatever game of Chinese Whispers ensued, OpenAI thought they had solved the full Navier Stokes problem, which they hadn’t. So OpenAI pointed their latest unreleased model at it, and it actually solved the full problem!! Pure George Danzig vibes on that one. So when this meeting happened, the OpenAI folks were surprised that these researchers had NOT solved the full problem, only the subset. Yet from their perspective, they were offering them credit for the full problem, and so “we’re being nice.” The Anthropic employee (Alpoge) was clearly an optics issue and so they felt they didn’t have to be that nice. But the other researcher, Buckmaster, was suspicious that their work had been stolen, and so was understandably in a combative mood. You can see that from his perspective they were not being “nice”, they were trying to scoop them, possibly on stolen work, and then bribe them with shared credit. But they had not solved the full problem, and academic plagiarism is a very serious allegation that can ruin careers of both the accused and the accuser. So from OpenAI’s perspective it was like, why would you accuse us of plagiarism when you yourself have not solved the full problem and when we’re willing to share undue credit for it?? This was made worse by the fact that OpenAI would not categorically deny if the others’ work had been used for training until much much later. This was terrible optics, but anyone who’s dealt with large scale data pipelines compounded by privacy issues knows that it gets very difficult to trace these things, so it takes time to make a definitive statement. Alpoge somehow seemed less troubled by this whole episode, but I guess it’s because not only was he gonna be a multi-millionaire soon, he had Riemann stewing on his backburner. I feel like when they finally make a movie out of all this, this scene would end up being a bit of comic relief. | | |
| ▲ | irthomasthomas 2 hours ago | parent | next [-] | | That version of events skips some central facts from Buckmaster’s statement. "they came prepared and they wanted to show us the prompt... they showed me on the screen and they just literally copy pasted the Millennium Prize problem, so they said that they took the prize and they pressed enter and they got a solution, and at that point I just had to laugh because it's just so ridiculous. It came out within a few minutes that this was a lie" "Levent had been told by Sebastien 'very little human input' had been used. This turned out not to be true. Over the course of the call, as members of their team sent Sebastien corrections and details over their internal chat, it emerged that an entire team had been working on the problem..." "I was offered the opportunity to write as sole author of their paper and throw my collaborator under the bus... they were asking me to throw him under the bus, someone who I've been working with for a year, to throw him under the bus just because he's an Anthropic employee" "the right paper to compare is the unforced Euler equation. Now the unforced Euler equation, all the mechanisms in this unforced Euler equation are identical to a different version of the Euler paper that we haven't released yet... basically all the main architectural ingredients in that unforced Euler were in our work for which they would have had on their servers, and it hadn't been published"
"they didn't use 10,000 agents to get to the Euler problem, they used 100 agents. So they worked from absolutely nothing with only 100 agents... and then they ended up with an identical architecture to what we had" | | |
| ▲ | randysalami an hour ago | parent | next [-] | | Not to put anyone on an idol but the only one who comes out of this not acting like a greedy, anti-human is Buckmaster and his colleague (I think). Straight up lying by OpenAI, very predatory "meritocratic" behavior. What gets me the most is "they didn't use 10,000 agents to get to the Euler problem, they used 100 agents. So they worked from absolutely nothing with only 100 agents... and then they ended up with an identical architecture to what we had". What the hell! So they lie about their technical claims too on a factor of 100x?? And companies are taking their words seriously, no wonder there is a house of cards being built in the industry. | |
| ▲ | keeda an hour ago | parent | prev [-] | | I don’t see how those details change the overall outline of what I presented above through? Maybe you could nitpick that it was a team with a model using 100 agents, and not a solo model with 1000 agents. But the fact remains OpenAI ended up solving the bigger problem themselves just because they thought the researchers had solved it already when they hadn’t. That is low-key hilarious. The Euler plagiarism insinuations are much more serious but given all the 100s of other results we’ve seen come out, highly unlikely. |
| |
| ▲ | ameliaquining 2 hours ago | parent | prev | next [-] | | I think it's clear enough that something broadly like this is right, even if people don't want to admit it because the vibes of extending any charity at all to frontier labs are bad. | |
| ▲ | bdelmas 2 hours ago | parent | prev [-] | | Terrible optic is such a bs executive wording when they lied, coerced, bullied, and threatened him… I like the summary but knowing what irthomasthomas posted that’s missing from it, and having a better picture of what happened; terrible optic doesn’t work. |
|
| |
| ▲ | simonw 5 hours ago | parent | prev | next [-] | | Yes, it was a joint effort with Tristan. Part of the scandal around it came when OpenAI offered to let Tristan help write up their result but wouldn't allow Levent to be involved because he worked for their competitor. | |
| ▲ | Betelbuddy an hour ago | parent | prev | next [-] | | >> Almost unprovable of course. Very much provable, if he would sue, and a lawyer would ask for discovery. | |
| ▲ | an hour ago | parent | prev [-] | | [deleted] |
| |
| ▲ | BoppreH an hour ago | parent | prev | next [-] | | He was also the one who dropped the Jacobian conjecture counterexample on twitter with the famous > hello there the jacobian conjecture is false thanx to my close friend akhil for asking about it and my other close friend fable for working during the world cup final and prompted Fable with > You should do a breakthrough | |
| ▲ | QuesnayJr 5 hours ago | parent | prev [-] | | It's a sign of the times that when someone with an AI beats you to one Millenium Problem, you can just turn the attention of your AI to another Millenium Problem. | | |
| ▲ | finghin 5 hours ago | parent | next [-] | | It's almost certain that they have had people working on Riemann since way before the Navier-Stokes theorem proof was nearing completion. It's a long shot, but the value of a proof is next-level compared to NS | | |
| ▲ | thaumasiotes 4 hours ago | parent [-] | | > It's a long shot, but the value of a proof is next-level compared to NS The value of a proof? People have assumed it's true for so long that there are any number of results already proved "if the Riemann hypothesis is true". What value does the proof add? | | |
| ▲ | DennisP 4 hours ago | parent | next [-] | | There are also lots of results proven "if the exponential time hypothesis is true," and now it looks like an AI has proven it false. | |
| ▲ | SubiculumCode 4 hours ago | parent | prev | next [-] | | "... but what I saw during the course of progress so amazed me that I believe it is one dawn across science of something
far greater." | |
| ▲ | QuesnayJr 2 hours ago | parent | prev | next [-] | | Doesn't that increase the value? We now know all of those results are true, where before we didn't. | | |
| ▲ | kypro an hour ago | parent [-] | | If value here is a measure of utility, its not super useful on its own that something that was almost universally assumed to be true is now known to be true. But with a problem as difficult and fundamental as the Riemann Hypothesis the thought has always been that in the process of solving it we'd be likely to develop or discover something that did have real world utility. At least this is often what happened in the past, the obvious example here being Newton developing calculus, a field of mathematics which can be applied to other problems beyond the narrow set of problems he was trying to solve. What I find interesting about this, if the claim holds up, is whether this will assumption will remain true, or if the value of these AI proofs is going to significantly lower than those of human discoveries in the past. Maybe a good analogy here is to think about how all of tools we humans have created has been ultimately in the pursuit of solving some problem. For the developers here, consider this – if ChatGPT had existed before React, would React ever have been developed? I mean, if an LLM can brute force the same result with just vanilla JS the need to develop frameworks and libraries to solve what was once difficult for a human to solve drops. I'll note that I'm playing devils advocate here as I think AIs would probably build something better than React had it not existed, but it's something to think about at least. I suspect there's a higher probability than some here are assigning that this proof ultimately ends up have relatively little utility. | | |
| ▲ | QuesnayJr 33 minutes ago | parent [-] | | It wasn't assumed it was true. People thought a world in which it was true was more beautiful than one where it wasn't, but proving it true wasn't a pesky little detail. In fact, there was a whole literature of papers proving that if the GRH was false in one particular way (the existence of Landau-Siegel zeroes) many theorems followed from it. For example, if there's a Landau-Siegal zero, the twin primes conjecture is true. |
|
| |
| ▲ | ncallaway 4 hours ago | parent | prev | next [-] | | Well, for one all those other results that assumed Riemann was true are now also known to be true. That seems valuable | |
| ▲ | applicative 4 hours ago | parent | prev | next [-] | | That there are so many results beginning 'if RH' has exactly the opposite significance you are trying to suggest. | |
| ▲ | Jweb_Guru 4 hours ago | parent | prev | next [-] | | The value it adds is that those theorems are now actually true, which means all those derived results are "real" mathematics... as every mathematician knows, it is quite easy to prove very surprising theorems when False is in your context. | | |
| ▲ | thaumasiotes 3 hours ago | parent [-] | | But that's 100% wrong. If it was easy to prove surprising theorems from an assumption of the Riemann hypothesis, it would also be easy to disprove the Riemann hypothesis. | | |
| ▲ | Jweb_Guru 3 hours ago | parent | next [-] | | To borrow the usual quote about ingenious fools, the trouble with "easily" disproving that False is in your context is that there are such ingenious proofs of False. One can appear to be doing very substantial and sophisticated mathematics, encountering many obstacles along the way that look identical to what you'd face if you were relying on something true, only to realize much later that one of your hypotheses is uninhabited. The concern was that were the Riemann Hypothesis false, a very, very large subset of modern mathematics might fall into this category. | |
| ▲ | xrisk 3 hours ago | parent | prev [-] | | not at all. we can prove a lot of things using P != NP, but that doesn’t make a proof or disproof of that statement easy |
|
| |
| ▲ | baq 3 hours ago | parent | prev | next [-] | | 150GB of lean must be worth something | |
| ▲ | lern_too_spel 4 hours ago | parent | prev | next [-] | | The post mentions some generally useful machinery derived on the way to the proof. | |
| ▲ | 3 hours ago | parent | prev | next [-] | | [deleted] | |
| ▲ | thevalueisai 4 hours ago | parent | prev [-] | | The value is proving AI can be useful after all (and we're fucked). Remember, not too long ago we had hordes of folks here proclaiming machines can't think, reason or be creative in any productive sense. Many still do, but it's starting to look bleaker by the day. | | |
| ▲ | agentultra 4 hours ago | parent | next [-] | | This is a competent person using a tool in their work. The tool isn’t doing the thinking or the proof on its own. It also hasn’t been vetted/verified yet. There’s still work to do. | | |
| ▲ | 3 hours ago | parent | next [-] | | [deleted] | |
| ▲ | 0c3ca83 2 hours ago | parent | prev [-] | | What were the prompts? For many of the proofs coming out of the AI companies where the prompts were posted, they ended up being variants of "solve the problem", "keep going", "I believe in you". Many of the results could have come from a 15 year old that heard of the problem in passing. The result here is a quarter of a million pages. Human involvement is going to be minimal. | | |
| ▲ | what an hour ago | parent [-] | | If you believe these were the prompts, I’ve got a bridge to sell you. |
|
| |
| ▲ | ThrowawayR2 3 hours ago | parent | prev | next [-] | | These AI bros don't get it. These LLM systems solving math problems have the benefit of being constrained by formal rules of math providing constant feedback when they break the rules that prevents them from wandering into la-la land. As Dijkstra said in his prescient "On the Foolishness of 'Natural Language Programming'": > "The virtue of formal texts is that their manipulations, in order to be legitimate, need to satisfy only a few simple rules; they are, when you come to think of it, an amazingly effective tool for ruling out all sorts of nonsense that, when we use our native tongues, are almost impossible to avoid." To whatever extent that LLMs can "think, reason, or be creative" in generating these proofs (or writing code), they're aided by very high guardrails so it doesn't say very much about what they can do in broader, fuzzier domains. | | |
| ▲ | randomNumber7 an hour ago | parent | next [-] | | Goedel proofed that you can formulate nonsensical statements in math (and any formal system that is complex enough to be useful) | | |
| ▲ | ThrowawayR2 31 minutes ago | parent [-] | | Gödel proved that statements can be created that are definitely true or false but for which no proof can be constructed. It is not relevant here since proofs are successfully being constructed, according to checking using Lean, by an LLM. |
| |
| ▲ | brookst 2 hours ago | parent | prev [-] | | Would you say that the early results of AI beating humans at backgammon and checkers had any predictive power towards chess and go? | | |
| ▲ | ThrowawayR2 2 hours ago | parent [-] | | The kind of AI used for backgammon/checkers and the kind of AI used for chess/go, and LLMs differ greatly so I'm not sure what the point of your question even is. A casual check says that the state of the art LLMs have much lower [EDIT]Elo ratings for checkers than the purpose built "AI" that beat humans. | | |
|
| |
| ▲ | ToucanLoucan 4 hours ago | parent | prev [-] | | > Remember, not too long ago we had hordes of folks here proclaiming machines can't think Machines can absolutely think. It's really all they do. > reason Murky, but LLMs prove with an avalanche of statistical modeling, they can do something kind of analogous to reasoning, with the caveat that whatever they output will necessarily have to exist in some fashion in their training data. > or be creative Absolutely not. By definition an LLM cannot create original work, it can only remix and recombine what it already knows. That can be interesting, and bloody useful especially for code tasks, but it is not making anything original. | | |
| ▲ | retsibsi 4 hours ago | parent | next [-] | | > Absolutely not. By definition an LLM cannot create original work What (if anything) unambiguously counts as original work, according to this definition? | | |
| ▲ | ToucanLoucan 4 hours ago | parent [-] | | Arguing the definition of original is pointless for the exact reason you point out: that it's ambiguous. Due to the nature of how an LLM works, it cannot make anything truly new, it, again, can only recombine and remix things from it's training data. This is why AI images/writing are so easily spotted, and even AI code to a degree: they have a distinct "style" as a consequence of how they work. I leave what is truly original to the philosophers. What I can say for certain, is that anything you get out of any of these models is a remix of what is present in it's training data, because gravity exists and energy is conserved. They are not intelligent, they are not conscious, and they cannot make New things. | | |
| ▲ | retsibsi 3 hours ago | parent | next [-] | | > What I can say for certain, is that anything you get out of any of these models is a remix of what is present in it's training data, because gravity exists and energy is conserved. But doesn't that same argument apply to humans, where 'training data' = all our sensory inputs (plus what's encoded in our DNA, depending on whether we want to analogise that to the training data or the underlying architecture)? > Arguing the definition of original is pointless for the exact reason you point out: that it's ambiguous. I'm not trying to be a smartarse here but you are the one who is claiming absolute certainty that something is false 'by definition', so I think the onus really is on you to have a precise definition in mind. > They are not intelligent, they are not conscious, and they cannot make New things. I'm not a consciousness denier or anything, in fact I think it is the most important thing in the world, but I don't understand the connections you're making here. 'Intelligent', like 'original', can be defined and needs to be defined for this statement to be meaningful. 'Conscious' is probably inherently slippery, but if we mean the same thing by it (having subjective experience/qualia) then I have no idea how you could be certain that any other entity lacks it. And it seems like you may be implying that consciousness is a necessary condition for originality, but I don't think you've explained how. | |
| ▲ | jonahx 3 hours ago | parent | prev | next [-] | | > Due to the nature of how an LLM works, it cannot make anything truly new, it, again, can only recombine and remix things from it's training data Fwiw, David Hume made this exact argument about human imagination: > But though our thought seems to possess this unbounded liberty, we shall find, upon a nearer examination, that it is really confined within very narrow limits, and that all this creative power of the mind amounts to no more than the faculty of compounding, transposing, augmenting, or diminishing the materials afforded us by the senses and experience. [David Hume — An Enquiry Concerning Human Understanding (1748), Section II, Paragraph 5] | |
| ▲ | WarmWash 3 hours ago | parent | prev | next [-] | | Everything is either deterministic, random, or a mix of that. New is just a mix of deterministic and random. LLMs are not deterministic. You don't even need an LLM to create something new and improved. Evolutionary algorithms have been doing it since the 80's. | |
| ▲ | hardbass 3 hours ago | parent | prev | next [-] | | Non answers are best ignored. You have failed to define what creativity is and therefore failed to prove whether llms are "creative" or not. What exactly are you trying to say about gravity and thermodynamics? You may be confused but these are universal physical laws that apply to everything, humans, computers, anything else. At its most basic level if I had to start with defining creativity, it should be some kind of intelligent filtering process. The brain can be in a huge number of state configurations, the interesting and novel among them are "creative" ideas. We can build upon it further. I am happy to say I am no philosopher and I will defer to those with expertise on it. But if you don't have any definition for it, its quite strange to make up some beliefs about it without proof. | |
| ▲ | drdeca 2 hours ago | parent | prev | next [-] | | You’re the one who said “ By definition an LLM cannot create original work”, so I think responding asking for the definitions you are talking about is quite justified? Often when someone says that something is true by definition, their claim is incorrect. | |
| ▲ | 3 hours ago | parent | prev | next [-] | | [deleted] | |
| ▲ | brookst 2 hours ago | parent | prev | next [-] | | Does your same argument hold for humans’ inability to do more than remix? Gravity exists and energy is conserved for us, too. | |
| ▲ | CamperBob2 2 hours ago | parent | prev [-] | | Arguing the definition of original is pointless for the exact reason you point out: that it's ambiguous. Well, it certainly wasn't "ambiguous" two posts ago when you said "Absolutely not. By definition an LLM cannot create original work." Make up your mind. You've been beating this drum since roughly GPT 3.5, as I recall. Your goalposts aren't even on the field anymore, they're gathering dust in a far corner of the parking garage down the street from the stadium. Time to update your priors. |
|
| |
| ▲ | haickernews 3 hours ago | parent | prev | next [-] | | If you can be persuaded, looking into how modern LLMs are trained with reinforcement learning may change your views. | | | |
| ▲ | squidmaster 3 hours ago | parent | prev [-] | | [dead] |
|
|
|
| |
| ▲ | gauze 4 hours ago | parent | prev [-] | | Even after all the MPs are beat, there's still work to do to actually understand them, communicate them, and transform them in a way that can be leveraged. I predict that's going to be much harder for AI to solve. |
|
|
|
| ▲ | artninja1988 5 hours ago | parent | prev | next [-] |
| Is it really wise to only rely on credentiallism to verify things? Plenty of mathmaticians top of their fields believed they have proven something when the proof contained some flaw. Just look at Mochizuki |
| |
| ▲ | tptacek 3 hours ago | parent | next [-] | | Hacker News is a water cooler conversation, not a peer review system. It is in fact quite useful in this context to short circuit a whole raft of standard dismissals! We went through this with Alpöge over the Jacobian Conjecture and the resulting thread was pretty embarrassing. | | |
| ▲ | moralestapia 3 hours ago | parent [-] | | On this water cooler conversation, I sure appreciate the comments of my fellow @artninja1988. If anything goes, anything goes. | | |
| ▲ | supern0va 2 hours ago | parent [-] | | > If anything goes, anything goes. This sort of black and white thinking isn't helpful. Their point in giving context about the author is to give you more data for your internal heuristic to figure out whether this result is plausible and worth discussing. As opposed to, for example, someone with AI psychosis on Twitter posting that they've solved it. Even if Terence Tao came down from the clouds with a beautiful human-written proof, no one would be certain that it is solved--people make mistakes. But again, it gives confidence and something fun to discuss until the math community digests it fully and comes to a consensus. Anyway, TL;DR is that no one is telling you to go put your life savings on a prediction market bet that it's solved. Relax a little. |
|
| |
| ▲ | lanstin 5 hours ago | parent | prev | next [-] | | Math is hard; even to understand the questions and what the entities are which the questions address takes a lot of deep study, even for smart people. So credentials are not sufficient but they are for sure necessary. I have tried my whole life as a software engineer to study math as an amateur and then started a masters program and learned more details thoroughly in three months than in decades of self teaching. | | |
| ▲ | hephaes7us 3 hours ago | parent | next [-] | | The study is what's necessary. The guidance of a program is a helpful accelerant. A credential is merely suggestive. | | |
| ▲ | lanstin 3 hours ago | parent [-] | | Not in a Bayesian sense, not "merely" suggestive, but quite suggestive. Not sure how many full professors you have met, but they aren't like that under-performing coworker that people have to cover for. More like IIT grads in being, Bayesianly confident, quite exceptional. |
| |
| ▲ | Davidzheng 3 hours ago | parent | prev [-] | | Why is it necessary--just check the proof |
| |
| ▲ | killerstorm 4 hours ago | parent | prev | next [-] | | Nobody claims it's verified. It just seems very plausible. It really irks me that people think beliefs have to be binary rather than come in different degrees of certainty. | | | |
| ▲ | hyperpape 2 hours ago | parent | prev | next [-] | | No. The mathematicians will verify this, and come to a conclusion. What the credentialism does is establish that this should be taken seriously and has a real possibility of being right. The Lean also helps (no Lean for Mochizuki’s work). | |
| ▲ | 3 hours ago | parent | prev | next [-] | | [deleted] | |
| ▲ | questionable_ju 5 hours ago | parent | prev | next [-] | | he's just pointing out that this isn't some rando claiming to have video of aliens. | |
| ▲ | 317070 5 hours ago | parent | prev | next [-] | | credentialism, and a lean codebase that compiles and certifies Riemann is correct. | | |
| ▲ | well_ackshually 5 hours ago | parent [-] | | No. A lean codebase that certifies that whatever definition of the Riemann hypothesis their LLM wrote is correct. I can write Lean that certifies that 2 + 2 = 5 is correct, by redefining every axiom about natural numbers on the way. Or abusing bugs in Lean. Stop believing Lean is the response to everything. | | |
| ▲ | latent-person 4 hours ago | parent | next [-] | | Just like Navier stokes etc they use independently written Lean statements written by humans; formal conjectures [1]. Indeed, they have one for the Generalized Riemann Hypothesis too [2]. > I can write Lean that certifies that 2 + 2 = 5 is correct, by redefining every axiom about natural numbers on the way. Which you would catch using comparator? > Or abusing bugs in Lean. And just like all the other ones, people check with multiple independent kernels, so you need to abuse bug(s) in all of them. > Stop believing Lean is the response to everything. Stop believing Lean is so flawed. [1]: https://google-deepmind.github.io/formal-conjectures/ [2]: https://google-deepmind.github.io/formal-conjectures/theorem... | |
| ▲ | math_dandy 4 hours ago | parent | prev | next [-] | | The statement of the Riemann hypothesis is included in the Mathlib library which is a human written and highly regarded foundation for formalization.
See
https://github.com/leanprover-community/mathlib4/blob/master...
for the two-line statement. For a discussion of how to check that the untrusted proof isn't playing fast-and-loose with the axioms of mathematics or exploiting kernel bugs, see Kevin Buzzard's recent post "...and the proof is checked in Lean" at https://xenaproject.wordpress.com/2026/11/12/and-the-proof-i.... | |
| ▲ | astrange 4 hours ago | parent | prev | next [-] | | It imports a standard definition of RiemannHypothesis. It could be wrong in other ways, but not that one. | |
| ▲ | quchen 4 hours ago | parent | prev | next [-] | | The axioms would be a given to the theorem prover of course, as is the norm for theorem proving. This then reduces a complex proof to checking whether the theorem is stated correctly and the proof kernel is correct. This may not be (provably) easier, but it is so far removed from yet equivalent to the original problem that you get a machine-verifiable independent audit as a result. And don't reduce "is not the answer to everything" to "is the answer to nothig", there is tremendous value in automated verification, especially in the AI age where the moat to it going mainstream is shrinking by the day. | |
| ▲ | stale2002 4 hours ago | parent | prev | next [-] | | > whatever definition of the Riemann hypothesis Do you... think that there might be existing definitions for one of the most famous math problems of all time and that maybe they used that? Or do you think that they just vibe coded up a different definition, for kicks? This kinda feels.... easily provable either way. | |
| ▲ | steinwinde 4 hours ago | parent | prev [-] | | >whatever definition of the Riemann hypothesis their LLM wrote Given that the proof is provided by Levent Alpöge, who is known to be more than familiar with Lean, is it not unlikely he made up his own definition of the problem? https://leanprover-community.github.io/mathlib4_docs/Mathlib... |
|
| |
| ▲ | RunSet 2 hours ago | parent | prev | next [-] | | I understand the proofs generated by the slop engines are beyond mortal kenning, such that they must be backstopped by appeals to authority. | |
| ▲ | EGreg 4 hours ago | parent | prev | next [-] | | I heard Fermat himself had a marvellous proof, but it was too small to fit into the margins. A pity! | | |
| ▲ | abnry 3 hours ago | parent [-] | | I have a marvelous lean proof but my hard drive is too small to contain it. |
| |
| ▲ | dgellow 5 hours ago | parent | prev [-] | | No it’s not. HN main approach to analyzing anything is to rely on chaining heuristics. Which is generally sort of fine for software, but doesn’t make sense in the real world. It’s at best one signal to weight in your analysis, nothing else | | |
| ▲ | wat10000 4 hours ago | parent [-] | | It's the only realistic way to operate for nearly everything. Try determining whether a sandwich is safe to eat without applying a shitload of heuristics. | | |
| ▲ | swatcoder 4 hours ago | parent | next [-] | | The difference is that you generally need to eat something and so drawing some conclusion about th sandwich is essentially forced upon you. Getting buzzed over headlines about math or medicine or whatever, on the other hand, is just an irrelevant hobby of bored gentry and the opportinity to just not draw a conclusion at all remains open. | | |
| ▲ | TeMPOraL 3 hours ago | parent | next [-] | | Tell that to the general population wrt. politics. The "opportunity to just not draw a conclusion" has a much greater payoff there. | |
| ▲ | wat10000 4 hours ago | parent | prev [-] | | Do you just not contemplate anything that isn't directly related to your physical needs? What a sad existence. I wonder what you're doing here, in that case. |
| |
| ▲ | mtlmtlmtlmtl 4 hours ago | parent | prev [-] | | Easy. Eat the sandwich, see what happens. No heuristics necessary. |
|
|
|
|
| ▲ | auntienomen 5 hours ago | parent | prev | next [-] |
| Alpoge is a smart and principled guy, and he is probably the world leader at getting LLMs to do math. But he's not an expert in these subjects. If we're going to argue from authority, let's wait for an actual authority to weigh in |
| |
| ▲ | xyzzyz 4 hours ago | parent | next [-] | | Of course he is an expert in these subjects. He has a mathematics PhD from Princeton, with a thesis on algebraic geometry. If you cannot call someone like that an expert, you cannot really call anyone that. | | |
| ▲ | auntienomen 4 hours ago | parent | next [-] | | It probably looks like that to someone outside mathematics. But a math PhD from Princeton (even in arithmetic statistics, which is what he actually studied) doesn't make you an expert in the Riemann hypothesis. | | |
| ▲ | xyzzyz 4 hours ago | parent | next [-] | | I have a graduate degree in mathematics, with a thesis in algebraic geometry myself. I know what I know and what are my limits. I am not an expert in Riemann hypothesis now, but if I spent a couple of months of focused study, I would be. That’s where Levent surely is right now, at the very least. | | |
| ▲ | godelski 2 hours ago | parent | next [-] | | You two are just talking past one another and using different, and valid, definitions of experts. Yes, Alpoge is an expert in mathematics. Though how much of an expert he is in number theory? I don't know, I'm not an expert in number theory myself, I don't know Alpoge, and I don't know where he's been focused lately. But either way both of your arguments comes down to speculation unless you two are also experts in number theory and know Alpoge or at least what he's been working on (to a sufficient level). | |
| ▲ | fn-mote an hour ago | parent | prev | next [-] | | > if I spent a couple of months of focused study, I would be It seems more likely that in a few months you would discover the depth of what you do not know about RH. If you are a very accomplished geometer, I apologize, but from anyone else this would be very egotistical. | |
| ▲ | auntienomen 3 hours ago | parent | prev [-] | | I think we mean different things by expert. You appear to mean "superficially familiar with some known approaches to the problem". That's all you're going to get in months. And, yes, I've also published papers in algebraic geometry. | | |
| ▲ | xyzzyz 3 hours ago | parent [-] | | Yes, if by “expert” you mean one of the top 10 people in the world, then sure, but that not how regular people typically use the word. | | |
| ▲ | datsci_est_2015 2 hours ago | parent | next [-] | | Silly definition. I'm a "top 10 people" in the application Data Science to [niche that my company works in] because there are so few people working in this area, but I've only scratched the surface in my 3 years of working specifically in this domain. Some things just really aren't well-understood or well-studied. And other things are extremely well-studied and well-understood where 10 is significantly too low a limit. | |
| ▲ | jeremyjh 3 hours ago | parent | prev | next [-] | | I disagree. I don’t know that the answer is 10, but its definitely a very small fraction of math PhDs and they all know each other. | |
| ▲ | Vachyas 3 hours ago | parent | prev [-] | | If only 10 people understand the problem well enough to contribute to it, then yeah, that would be a case of a problem with only a handful of experts. I don't think regular people would have a problem with that, since the idea that some problems could be _that_ deep isn't particularly new. |
|
|
| |
| ▲ | FeepingCreature 4 hours ago | parent | prev | next [-] | | His writeup says he's been angling to work on Riemann since he was a student. It does seem plausible he's an expert. | | |
| ▲ | Tuna-Fish 3 hours ago | parent | next [-] | | From the writeup for the lazy: > It was my secret in my student days that my plans were for this problem in
decades, which meant then that I tried to become familiar with all tools that I
could possibly recognize in the problem when it was time | |
| ▲ | auntienomen 4 hours ago | parent | prev [-] | | I'm going to wait for Sarnak to weigh in. | | |
| ▲ | ahurmazda 4 hours ago | parent | next [-] | | Alpöge is a grand-disciple of Sarnak. Alpöge -> Tsimerman -> Sarnak | |
| ▲ | _flag 4 hours ago | parent | prev [-] | | Sarnak weighing in is completely irrelevant. There is a lean formalisation, and it either compiles or it doesn't. (And the statement of RH is well established so there is no issue there.) | | |
| ▲ | nocturn9x 2 hours ago | parent [-] | | Lean can and does have bugs. It compiling doesn't mean anything, because that doesn't tell you whether the proof actually encodes what the mathematician intended. Plus, again, there can be prover bugs. | | |
| ▲ | _flag 13 minutes ago | parent [-] | | In principle, sure. But the likelihood of a plausible proof strategy produced by an AI agent with human assistance somehow accidentally exploiting a Lean bug is incredibly low. In any case, the fact that the Lean compiles is certainly going to be, in this setting, a more reliable assessment of the proof's correctness than the opinion of any expert, unless that opinion also comes with an identification of the bug being exploited. |
|
|
|
| |
| ▲ | causal 4 hours ago | parent | prev | next [-] | | Feels like we're reaching for arbitrary levels of expert to undermine the claim. I'm sure the world's foremost Riemann Hypothesizer will come forward at some point, but we don't need to wait for that to take the Princeton math PhD seriously. | |
| ▲ | Davidzheng 4 hours ago | parent | prev | next [-] | | There are actually no experts on the Riemann hypothesis bc before now no one knows how to do anything lol | |
| ▲ | bad_haircut72 4 hours ago | parent | prev [-] | | Its all relative. If you're on hackernews then conpared to you, dear reader, hes an expert. | | |
| ▲ | dang 2 hours ago | parent | next [-] | | "Please don't sneer, including at the rest of the community." It's reliably a marker of bad comments and worse threads. https://news.ycombinator.com/newsguidelines.html p.s. FWIW, I know of at least one Nobel Prize winner on HN. | |
| ▲ | auntienomen 4 hours ago | parent | prev | next [-] | | The beauty of the internet is that no one knows you're a dog. | |
| ▲ | danlitt 3 hours ago | parent | prev | next [-] | | What an odd thing to say. By this logic dumb people should defer to worse experts because "compared to you, they're very smart". Dumb people need the best experts of all! | |
| ▲ | 4 hours ago | parent | prev [-] | | [deleted] |
|
| |
| ▲ | 3 hours ago | parent | prev | next [-] | | [deleted] | |
| ▲ | golemotron 3 hours ago | parent | prev | next [-] | | Credentials are not authority. Especially in math. | |
| ▲ | serioussecurity 4 hours ago | parent | prev | next [-] | | Math doesn't work like that sadly. | |
| ▲ | conradkay 4 hours ago | parent | prev [-] | | The model(s) that solved it is an expert, I guess. Maybe they can send it to OpenAI and have their internal model check. |
| |
| ▲ | HarHarVeryFunny 3 hours ago | parent | prev | next [-] | | Apparently he has a Lean proof, so all that needs to be verified is that the Lean formulation of the problem matches the hypothesis, which I assume he's qualified to do (and has done). | |
| ▲ | killerstorm 4 hours ago | parent | prev [-] | | Did you read the document? He is very much an expert. JFYI you don't need a medal to be an expert. | | |
| ▲ | auntienomen 4 hours ago | parent | next [-] | | No, you need a long track record of working on the Riemann hypothesis. You need to be the person who's called to verify a possible proof of the Riemann hypothesis. I have a lot of respect for Alpoge, but he is not the person a journal would call to verify this. | | |
| ▲ | darkwater 4 hours ago | parent | next [-] | | Asking out of real curiosity, not trying to provoke at all: and what happens when somebody verifies it and say the result is legit? Would Alpoge become an expert on the topic or wouldn't, due to the AI assistance? Also, if it were the most expert person on the Riemann hypothesis the one working with AI to prove it, how would the verification work? The 2nd most expert person? Or would they be trusted directly? | | |
| ▲ | auntienomen 3 hours ago | parent [-] | | It's a fun question. I don't think AI assistance transfers expertise from the agents to the user. Alpoge says much the same thing himself, noting that Claude produced 250000 pages of slop and that he doesn't trust his own summaries in places. For the other question: We'd want multiple independent expert verifications. | | |
| ▲ | akie an hour ago | parent [-] | | Man, are you being deliberately obtuse? 250000 pages of proof in a formalized language is not "slop" |
|
| |
| ▲ | pell 3 hours ago | parent | prev | next [-] | | That’s a strange form of credentialism. I understand it if you wanna reject amateurs who make graphs and don’t understand what they’re saying but this is an actual mathematician and clearly he has thought about this particular problem for a long time. | |
| ▲ | killerstorm 3 hours ago | parent | prev | next [-] | | From the document: "It was my secret in my student days that my plans were for this problem in decades, which meant then that I tried to become familiar with all tools that I could possibly recognize in the problem when it was time". It's true that he haven't been publicly recognized as a top expert. But it's not like he's just a software dev who got lucky with prompting - he's a mathematician who specifically studied this problem. I don't think we should delegate gatekeeping to journals - a lot of crap is published, by "experts". (Also a lot of good results don't get published - there are well-known examples.) | |
| ▲ | francasso 4 hours ago | parent | prev [-] | | I don't get it, if the proof is formalized in Lean, the only expertise you need is running lean, asking if there were any additional axioms added in the proof that shouldn't be there, and if the statement being proved is the GRH (verifying all the definitions involved match expectations). | | |
| ▲ | LtWorf 3 hours ago | parent [-] | | You need to check that there are no bugs in the lean formulation of course. | | |
| ▲ | vetronauta 32 minutes ago | parent | next [-] | | The usefulness of a Lean proof is that it is possible to just look at the theorem statement and at the axiom that are used. Riemann hypothesis is quite straightforward to define and to be checked even by a undergrad. Obviously a bug in Lean kernel is still possible. | |
| ▲ | francasso 3 hours ago | parent | prev [-] | | If that means checking the formalized theorem states the GRH correctly yes, but you hardly need to be an expert in the RH to do that. |
|
|
| |
| ▲ | slashtom 4 hours ago | parent | prev [-] | | The paper is not a proof and has not been peer reviewed / published in a journal. So yes, let's wait and see. | | |
| ▲ | killerstorm 3 hours ago | parent [-] | | There's no paper. It's just a letter about the discovery. | | |
| ▲ | auntienomen 3 hours ago | parent [-] | | The lean proof is public. Although, if it's anywhere near as long as the "natural language" proof, most people probably don't have enough compute to check that it compiles. footnote: I object to calling the langauge that Claude produces "natural". It appears to be uniformly distributed over the space of grammatical constructions. |
|
|
|
|
|
| ▲ | zug_zug 3 hours ago | parent | prev | next [-] |
| > If he says he has Riemann, well then, he has Riemann. Well he said he doesn't even fully understand the proof (250k pages). So it's more like "If lean says he has Reimann, then we presume he has Reimann." The best argument I've heard for lean being trustworthy is that different lean engines won't likely have the same bug. I guess what I'd like to see next is a list of every lean engine and its result for this? And then if that passes, presumably the goal is simplifying down from 250k pages. |
| |
| ▲ | TheBlight 17 minutes ago | parent | next [-] | | I don't have much of a math background but the author making such strong claims about a proof the author couldn't have possibly read seems absurd to me. What am I missing? | |
| ▲ | dingaling911 3 hours ago | parent | prev | next [-] | | What I don't understand about Lean is how is it going to avoid writing statements that are no-ops? How do we know all the lines in the proof aren't just gibberish? | |
| ▲ | jojomodding 2 hours ago | parent | prev [-] | | Exactly, people are running these computations right now. You could as well. It will take several hours, though. |
|
|
| ▲ | kragen 4 hours ago | parent | prev | next [-] |
| He could still be mistaken. Andrew Wiles had a hole in his proof of FLT at first. |
|
| ▲ | SubiculumCode 4 hours ago | parent | prev | next [-] |
| It was fascinating to read, but without knowing that, it was hard to know whether the sentences indictating his ignorance of certain areas of mathematics involved was an indication that he was completely out of his depth, or the usual and appropriate caution of a fully qualified academic (the more you know, the less you think you know phenomenon). |
|
| ▲ | AnthonyMouse 4 hours ago | parent | prev | next [-] |
| > If he says he has Riemann, well then, he has Riemann. He works for the company, which is a conflict of interest. At that point it's not about credentials, it's about having someone with similar credentials but not the conflict of interest say the same thing. |
| |
| ▲ | bentt 4 hours ago | parent [-] | | Is it not a conflict of interest when a researcher who works at a University announces results? Let’s not act like the institution doesn’t benefit from the work of its employees. | | |
| ▲ | AnthonyMouse 4 hours ago | parent [-] | | Of course it is, that's why you need someone else to validate it. It's the entire premise of reproducibility, peer review, etc. |
|
|
|
| ▲ | testtestmetest 4 hours ago | parent | prev | next [-] |
| He also works for Anthropic and this claim comes the day after their lackluster IPO. |
| |
| ▲ | unddoch 3 hours ago | parent | next [-] | | Are you implying the timing of this is related to the IPO? If Anthropic cared about it with regards to the IPO, it stands to reason that they would release it a day before, not after. | | |
| ▲ | spoocecow an hour ago | parent | next [-] | | This is addressed directly on page 2 of the linked doc, no? > It is obvious to me that I should remark on the following.
> The precise timing is horrible. If I could have, I’d have finished this all much earlier. Hell, strictly before this age would have sure been nice. > This all happened for me late Sunday night, and I messaged Dario, "Hypothetically, if I were to have . . . ", eventually asking about my ability to announce. edit: Apparently I have forgotten how to format correctly | |
| ▲ | testtestmetest 2 hours ago | parent | prev [-] | | I believe every major announcement made by a public company comes with consideration of the stock price. |
| |
| ▲ | patrickkrusiec 3 hours ago | parent | prev [-] | | Considering the stock is down today I don't think markets care about math proofs. |
|
|
| ▲ | 27 minutes ago | parent | prev | next [-] |
| [deleted] |
|
| ▲ | MetaverseClub 3 hours ago | parent | prev | next [-] |
| What you said is exactly the opposite of the scientific research spirit: Instead of be suspicious and honest, you forge idols and blindly believe in them. |
|
| ▲ | xyzsparetimexyz 5 hours ago | parent | prev | next [-] |
| What do I have to do to get an asteroid named after me? |
| |
|
| ▲ | some_furry 5 hours ago | parent | prev | next [-] |
| > If he says he has Riemann, well then, he has Riemann. Yeah, no. This kind of framing is inappropriate. Let the mathematicians check the proof. |
| |
| ▲ | adastra22 4 hours ago | parent | next [-] | | That’s what he is saying though? | | |
| ▲ | some_furry 4 hours ago | parent [-] | | Is it? It sounds to me like glazing one person in particular rather than the rough consensus of the entire mathematics community. I'm saying the latter is necessary. |
| |
| ▲ | Bluestein 5 hours ago | parent | prev [-] | | [flagged] |
|
|
| ▲ | gosub100 4 hours ago | parent | prev | next [-] |
| > If he says he has Riemann Appeal to authority fallacy. The proof should stand or fall on its own. |
| |
| ▲ | 5upplied_demand 4 hours ago | parent | next [-] | | > The proof should stand or fall on its own. At some point in the chain an "authority" has to validate whether the proof stands or falls. | | |
| ▲ | soperj 4 hours ago | parent [-] | | sure, still wouldn't trust the guy who wrote the proof to verify it though, which is what this person is asking. |
| |
| ▲ | breakwaterlabs 4 hours ago | parent | prev | next [-] | | Appeals to authority are not inherently fallacious if the individual is, indeed, an authority on the topic at issue. To the contrary: we lean on authority opinion in most spheres of life because one individual's ability to understand is limited and so we abstract away "true" in auxiliary fields to mean, roughly, "held to be true by trusted authorities". We even rely on it in law. | | |
| ▲ | rvz 4 hours ago | parent | next [-] | | Just like when Andrew Wiles discovered the proof to fermat last theorem and Grigori Perelman with the poincaré conjecture, multiple authorities in the field got together and verified that the proofs were correct (even after Wiles initially had an error.) An appeal to multiple trusted authorities is better than a singular authority. So at best I'll keep as unverified until it is checked, unless you have read the 250,000 proof and checked that there is no issues or soundness bug with the lean proof. | |
| ▲ | thevalueisai 4 hours ago | parent | prev [-] | | They are inherently fallacious as in logically unsound. There is no connection between his credentials and him being right about this particular thing. It's very important to keep those things separate. | | |
| ▲ | breakwaterlabs 3 hours ago | parent [-] | | They are inherently fallacious as in logically unsound.
At the risk of triggering an infinite regression (or logic loop), the redoubtable Stanford Encyclopedia of Philosophy's page on fallacies provides the following (https://plato.stanford.edu/entries/fallacies/): The ad verecundiam fallacy concerns appeals to authority or expertise. Fundamentally, the fallacy involves accepting as evidence for a proposition the pronouncement of someone who is taken to be an authority ***but is either not really an authority or a relevant authority***.
Once more, I would point you to the fact that even the legal profession-- which is fundamentally one of the most epistemologically pure fields-- spefically allows the opinion of those deemed "authorities" to be submitted as evidentiary.See: https://www.law.cornell.edu/rules/fre/rule_702 Without an epistemology that allows integrating truth-by-authority, you by necessity need to prove every assertion from first principals. Have you done so? | | |
| ▲ | interestingsir an hour ago | parent [-] | | Very interesting sir. Thank you for this exposition. But I do not see how this changes the notion that being an authority does not turn your arguments sound or even valid. There is nothing to connect. I can be an expert and completely wrong and there is nothing epistemology can do for you there. The legal profession is taking a shortcut like the CS profession is taking a shortcut with the halting problem. Sure, we can end the discussion that way but we cannot use it as an argument otherwise.. halting problem solved, just press control-C? |
|
|
| |
| ▲ | Spacecosmonaut 4 hours ago | parent | prev | next [-] | | Of course it has to. Its not about that, its about whether or not to get excited. I think we can start to get excited. | |
| ▲ | emtel 4 hours ago | parent | prev | next [-] | | obviously the claim is about how much credence to assign the claim until the proof has been verified | |
| ▲ | jsLavaGoat 3 hours ago | parent | prev | next [-] | | >fallacy It doesn't make it right, but more importantly to people who always quote every known fallacy: it doesn't make it wrong either. We shall see, empirically how it goes. But it is highly relevant whether this is some crank on an Internet forum posting proofs about infinity-hat or someone with some credentials, even if that framing was a bit hyperbolic. Which is another thing: sometimes people aren't really making an argument as such, so quoting fallacies is just on purpose low bandwidth English comprehension. | | |
| ▲ | gosub100 an hour ago | parent [-] | | It's not about whether the claim right or wrong. "Fallacy" doesn't mean "a function that always returns false". It means it employs flawed reasoning. Saying "$SUPER_COOL_GUY claimed it" (implying it must be true) is a thought-terminating phrase. It's saying "don't scrutinize or question. Trust that he's the authority on these things. For only a fool would attempt to contravene his infinite wisdom.". That logic is absolutely flawed. Even Einstein was incorrectly critical about some quantum physics properties. Who would dare tell Einstein, the master of relativity and spacetime, that he was wrong? How could he possibly be wrong when it comes from the man who gave us the most famous math equation in history? |
| |
| ▲ | ndsipa_pomu 4 hours ago | parent | prev [-] | | Yes, that's right, but proof checking does take time and effort. For an initial announcement, the fact that they are a well regarded mathematician means that it's worth taking seriously and not that it's definitely correct. If it's someone unknown, then you'd definitely be waiting for the proof to be checked before talking about it. | | |
| ▲ | rvz 4 hours ago | parent [-] | | That is why it is still a "claim" of a proof, until other mathematicians verify it. Not saying it is incorrect but, all claims of mathematical proofs have to be checked over formally regardless of who discovered it. With this particular mathematician it just means it should be taken seriously but you cannot blindly believe it is correct without multiple authorities testing that there are no holes in the proof, just like they did with FLT and the poincare conjecture. |
|
|
|
| ▲ | keybored 5 hours ago | parent | prev | next [-] |
| * Levent Alpöge |
| |
| ▲ | gus_massa 4 hours ago | parent [-] | | (I think you posted this comment because the parent comment has a typo that was fixed later. Let's hope it goes back to black soon.) |
|
|
| ▲ | rfgplk 5 hours ago | parent | prev | next [-] |
| I don't understand this comment. For instance, > a supremely qualified mathematician How? No matter how "qualified" you are, the AI is still doing ~100% of the work. And since we're talking about superintelligence (Levent's intelligence hasn't even been stated anywhere), it's questionable whether a human can even "verify" or "check" the AI's work. |
| |
| ▲ | _fizz_buzz_ 5 hours ago | parent | next [-] | | - It's a lot more straightforward (easier) to verify a proof than to come up with a proof - It is also unclear if this proof is something a human couldn't have come up with | | |
| ▲ | fooker 4 hours ago | parent [-] | | > It's a lot more straightforward (easier) to verify a proof than to come up with a proof I don’t disagree, but this is not established science. We actually don’t know if it’s easier to verify a proof than to come with a proof. It’s one of the fun things that lead to P!=NP if it’s correct. Again, probably correct but if you could prove it that would be groundbreaking. |
| |
| ▲ | simonw 4 hours ago | parent | prev | next [-] | | > the AI is still doing ~100% of the work That's clearly not true here. | |
| ▲ | HotHotLava 4 hours ago | parent | prev | next [-] | | If you read through the pdf that this post links to, you'll find that while claude contributed many ideas and was ultimately responsible for the technical "implementation" of the proof, there was also a lot of non-trivial guidance and steering involved from Alpöge himself. He didn't just sit down and prompt "claude, solve the riemann hypothesis for me". If it was that easy, OpenAI would have already announced the result weeks ago. | |
| ▲ | steve_adams_86 4 hours ago | parent | prev [-] | | > the AI is still doing ~100% of the work So if we stick a 10 year old in front of Claude and instruct them to type in “create a proof of the Riemann hypothesis”, as long as they keep pressing return, eventually a proof will pop out? | | |
|
|
| ▲ | fearmerchant 5 hours ago | parent | prev | next [-] |
| Thanks, the title made it sound like the custodian walked by and typed "solve this" and found an answer. |
| |
| ▲ | 5 hours ago | parent | next [-] | | [deleted] | |
| ▲ | rfgplk 5 hours ago | parent | prev | next [-] | | That's pretty much what he did regardless. I can assert with absolute confidence that he read effectively 0% of the "proof". | | |
| ▲ | steve_adams_86 4 hours ago | parent | next [-] | | This isn’t anything like what using LLMs for complex problems looks like. I sometimes think AI doomers are terrified because they have no idea how this all works. | | |
| ▲ | sebzim4500 3 hours ago | parent [-] | | It isn't how this work was done, but it is basically how UGC and 400 other high profile theorems were proved by OpenAI so I'd say the doomers have a point. |
| |
| ▲ | _fizz_buzz_ 5 hours ago | parent | prev | next [-] | | Huh, what a conincidence that the AI presented the proof to Levent Alpöge (a top class mathematician) and not to some Rando McRandomface then? What are the odds? | | |
| ▲ | svnt 4 hours ago | parent | next [-] | | I posted below in detail, but the answer is because Levent works there, not because Levent “guided” anything. | | |
| ▲ | _fizz_buzz_ an hour ago | parent [-] | | He doesn’t really go into much detail here, but according to him he came up with the strategy: „ I had us on the line of combining two quite
different ideas present in a toy setting, one of which was already new and
shocking, making very simple one of the shadows of Riemann over which we
mathematicians felt most triumph. I guided us to the right situation analogous
to that toy setting, and then Claude began to leave me in awe.“ That does not sound like he typed: „solve rieman thingie, make no mistakes, plz!“ | | |
| ▲ | svnt 17 minutes ago | parent [-] | | Here is the description of the initial process: > Jarred Sumner, an Anthropic staff member (and non-mathematician), prompted Claude to “take a real stab” at the hypothesis itself, leaving the mathematical choices from there up to the model. Initially, Claude generated and tried 650 ideas, none of which worked. Jarred prompted Claude to try again, and it spent a day and a half coordinating about 60 Claude subagents, which this time went much deeper: between them, they ran 2,400 shell commands and wrote hundreds of Python scripts.1 The subagents ran thousands of numerical checks against known zeta zeros and refereed one another’s work. Throughout this process, Jarred's input was mostly limited to sending Claude messages of encouragement (mostly variants of “keep going” or “believe in yourself”).2 This seems to have helped Claude overcome some initial skepticism that it could make meaningful progress. Only after this person thought he/claude found a solution were the mathematicians brought in. |
|
| |
| ▲ | rfgplk 4 hours ago | parent | prev [-] | | A Rando McRandomface doesn't have access to millions to tens of millions of dollars to spend on tokens. | | |
| ▲ | rcxdude 3 hours ago | parent [-] | | There's a lot of Random McRandomfaces in Anthropic with the same access. |
|
| |
| ▲ | hersko 5 hours ago | parent | prev [-] | | How could you possibly know that? | | |
| ▲ | mkarrmann 4 hours ago | parent | next [-] | | It's a 250,000 page proof. By his timeline he had the first breakthrough about a month ago, and he admits to not understanding everything yet. Even if he were extremely prolific at reading through the math, he would have carefully read <1% of the proof in the last month. | |
| ▲ | svnt 4 hours ago | parent | prev [-] | | Because the writeup describes exactly that process: > Jarred Sumner, an Anthropic staff member (and non-mathematician), prompted Claude to “take a real stab” at the hypothesis itself, leaving the mathematical choices from there up to the model. Initially, Claude generated and tried 650 ideas, none of which worked. Jarred prompted Claude to try again, and it spent a day and a half coordinating about 60 Claude subagents, which this time went much deeper: between them, they ran 2,400 shell commands and wrote hundreds of Python scripts.1 The subagents ran thousands of numerical checks against known zeta zeros and refereed one another’s work. Throughout this process, Jarred's input was mostly limited to sending Claude messages of encouragement (mostly variants of “keep going” or “believe in yourself”).2 This seems to have helped Claude overcome some initial skepticism that it could make meaningful progress. > Having found this new result while attempting the task, Claude tested its work by having various subagents review the proofs, search for counterexamples, download 54 papers from the arXiv to check that its finding hadn’t already been made, and independently re-prove its finding from scratch. Claude volunteered to write its findings up as a paper, and recommended that a human number theorist validate its findings. > Levent Alpöge and Ralph Furman, two of Anthropic’s own mathematicians, examined Claude’s work to understand the new results and how they related to the prior work mentioned above. In parallel, Claude worked with another member of staff, Eric Easley, to produce a Lean formalization of the result, which passes the standard validation tool comparator. | | |
| ▲ | jasonlotito 4 hours ago | parent [-] | | Your comment literally disproves your own comment. Simply put: > Because the writeup describes exactly that process: This is a complete lie. | | |
| ▲ | svnt 4 hours ago | parent [-] | | He told to find a solution. It failed. He told it to try again, and to keep going when it stopped. He had no mathematical skill or ability to check the solution. so which part is the complete lie? | | |
| ▲ | jasonlotito 4 hours ago | parent [-] | | The third paragraph. You left that entire part out: the actual proof, the actual confirmation. The thing that's literally linked to at the top of this thread. There's an entire process here, and you just decided to leave the most important part out. So, your comment literally disproves your claim. Which makes you a liar. Go ahead. Get to this thread by removing that third paragraph. That is the critical part of this entire thing. | | |
| ▲ | svnt 3 hours ago | parent [-] | | You are conflating: a) “looked at claude’s work” b) read and understood over 200,000 pages of ai-generated proof everything they post to their website is marketing You also seem to be conflating “Levent guided the work” with “curious employee brute-forced some potential solution through an agent tree”. He (in this case both Levent and said employee) did not guide the work, it was in effect a random employee saying “solve this” over and over. |
|
|
|
|
|
| |
| ▲ | stavros 5 hours ago | parent | prev [-] | | Man, Good Will Hunting 2 is much more boring than the original. |
|
|
| ▲ | tzury 4 hours ago | parent | prev | next [-] |
| We shall see. Math is not “if he said then it is”. Last giant claimed to have it was Sir Michael Atiyah, but it was not the case. https://youtu.be/bKnqeWWr9-Y?si=uYVYN6UkGMOMab5B |
| |
| ▲ | senderista 2 hours ago | parent [-] | | Atiyah was widely considered to have lost it by the time he claimed a proof of RH. |
|
|
| ▲ | heisgone 5 hours ago | parent | prev | next [-] |
| Let's redefine AGI as solving every known problems to man so we can stop moving the goalposts. |
| |
| ▲ | yesbut 5 hours ago | parent | next [-] | | it hasn't solved any of mankind's problems yet. | | |
| ▲ | aeonik 5 hours ago | parent | next [-] | | It's solving tons of my problems every day... | | |
| ▲ | bhaak 4 hours ago | parent | next [-] | | Have you considered that you might not be representative of humankind? | | |
| ▲ | aeonik 2 hours ago | parent [-] | | I have actually considered the fact that I may secretly be an alien embedded into humanity, or perhaps a dog in disguise. But evidence really points to the contrary, so... no, I'm pretty confident I'm human with regular human stuff that AI solves for me. House and family stuff on top of the science and tech stuff that applies to a smaller portion of human kind. |
| |
| ▲ | win311fwg 5 hours ago | parent | prev [-] | | Hence why the previous comment expressed "mankind", not "HN accounts". | | |
| ▲ | derektank 4 hours ago | parent | next [-] | | What are “mankind”’s problems if not the problems of individual humans? It seems like we’re treading towards a definition of AGI that would imply most human beings aren’t generally intelligent, which seems wrong headed. | | | |
| ▲ | stale2002 4 hours ago | parent | prev [-] | | I think the point here is that quite a lot of problems are being solved and this is entirely self evident based on the stuff people are using it for right now. |
|
| |
| ▲ | DFHippie 5 hours ago | parent | prev | next [-] | | It will need cooperation from mankind. So do we. | |
| ▲ | apical_dendrite 4 hours ago | parent | prev [-] | | It's certainly creating a lot of new ones! |
| |
| ▲ | lionkor 5 hours ago | parent | prev | next [-] | | You can have the AGI label, you can put it next to the "actually, we've solved world hunger, people just aren't working hard enough" discovery, somewhere on the shelf with "every billion I make trickles down to the barista when I get a coffee at starbucks". The AGI label doesn't matter. You can call it AGI when you feel like it's generally intelligent--I've yet to see any model that even remotely seems intelligent, but it all depends on where your bar is. If this is superintelligence to you, that doesn't make it superintelligence to me. I can not have a single chat with an LLM without running into it clearly just predicting whatever sounds good instead of actually reasoning. I can't understand what sort of work people are doing where this seems super intelligent, or intelligent at all. | | |
| ▲ | kolinko 4 hours ago | parent | next [-] | | What is your definition of intelligence? | |
| ▲ | sebzim4500 4 hours ago | parent | prev [-] | | >I can't understand what sort of work people are doing where this seems super intelligent, or intelligent at all. Proving the Riemann Hypothesis apparently |
| |
| ▲ | GuB-42 3 hours ago | parent | prev | next [-] | | And yet, we still can't make a robot that can clean a room. I mean really clean a room, picking up trash and put it into the bin, clothes on the floor go into the laundry basket, remove stuff from the shelves, dust it and put it back, etc... the kind of job any maid can do. Not like a Roomba that can be defeated by a loose sock. AGI means "general", a machine that can solve problems geniuses have struggled with while failing at problems that can be solved by minimum wage workers is hardly general, instead, it is a good specialized tool. | | |
| ▲ | 012forthee 3 hours ago | parent [-] | | If Moravec's paradox is anything to go by, the "embodied" tasks will end up being the ones most difficult for AIs to do. |
| |
| ▲ | keybrd-intrrpt 4 hours ago | parent | prev | next [-] | | How about when it picks me, and nobody else, the winning Powerball numbers. | |
| ▲ | thevalueisai 4 hours ago | parent | prev [-] | | Proving GRH never was the hard part of the job anyway.. |
|
|
| ▲ | irthomasthomas 3 hours ago | parent | prev | next [-] |
| Why Ant stock is down down down?
https://finance.yahoo.com/quote/ANT/ |
| |
|
| ▲ | tedecristal 2 hours ago | parent | prev | next [-] |
| "If he says he has Riemann, well then, he has Riemann." that's now how mathematics works, but I guess it goes to show how non mathematicians understand the subtle differences between math and other fields |
|
| ▲ | igleria 5 hours ago | parent | prev | next [-] |
| Congratulations on making my palms sweaty. Fields medal for Levent/Claude... |
|
| ▲ | hmokiguess 5 hours ago | parent | prev | next [-] |
| If only we stopped with the marketing and named the person, so sad to see someone like him reduced to "Anthropic Employee" |
|
| ▲ | irthomasthomas 4 hours ago | parent | prev | next [-] |
| Is this another $1 million Clay prize flushed down the drain, or can he actually claim this one?
I guess it's small fry to him given recent business news. Sort of a shame that all of these prizes are disappearing. Perhaps we should give the prize money to a body of mathematicians to do stuff with. |
| |
| ▲ | margorczynski 2 hours ago | parent [-] | | I think technically he could even though his input into the proof was most probably cosmetic and the work was done by the AI. |
|
|
| ▲ | acjohnson55 3 hours ago | parent | prev | next [-] |
| Easy now. I know we're all excited, but this is what peer review is for. |
|
| ▲ | croes an hour ago | parent | prev | next [-] |
| He says > I believe I have, working with Claude, discovered a proof of the Riemann
Hypothesis |
|
| ▲ | charles_f 5 hours ago | parent | prev | next [-] |
| Q.e.d. |
| |
| ▲ | ilaksh 5 hours ago | parent | next [-] | | He did post the Lean proof. Also the Wikipedia says that the full written proof is 250,000 pages. Which I am guessing might be a mistake. If not it could take a while for humans to verify it. | | |
| ▲ | bonzini 5 hours ago | parent | next [-] | | He says it in a footnote, probably referring to ~2M lines of Lean? | |
| ▲ | CapnTrippy 4 hours ago | parent | prev | next [-] | | :) 250k pages?!
I could believe that, maybe. It might amount to - "It's true, because the rest of maths is true" Which I suppose, in any consistent universe, must be true for all proofs, just that up until now, our proofs have been relatively simple. Interesting question occurred to me - how long can any proof get before it can be simplified? I suspect arbitrarily long, even for problems that can be simply stated. | |
| ▲ | 3 hours ago | parent | prev | next [-] | | [deleted] | |
| ▲ | well_ackshually 5 hours ago | parent | prev [-] | | [flagged] | | |
| ▲ | hackyhacky 5 hours ago | parent [-] | | > Even if their discovery happens to be wrong. (lol navier stokes) Has it in fact been shown to be wrong? | | |
| ▲ | well_ackshually 4 hours ago | parent [-] | | There are dozens of papers claiming that their formalization is wrong, that their natural language claims do not match the lean version of it, some parts of the proof are insufficient. finally, their entire proof relies on an external force. For a problem that is about, for 99% of people that care about it... unforced fluids. but hey, it gets them a month of being talked about. | | |
|
|
| |
| ▲ | solyin 5 hours ago | parent | prev [-] | | Quod Erat Demonstrandum, meaning "that which was to be demonstrated" or "what was to be shown" | | |
| ▲ | igleria 5 hours ago | parent | next [-] | | We used to joke at university that it meant "queda entonces demostrado" | | |
| ▲ | darkwater 5 hours ago | parent | next [-] | | I believe it's actually the correct "reverse acronym" in Spanish? I mean, keeping the Latin one they created a Spanish version that has the same meaning, in Spanish. In Italian we use "CVD" for it (Come Volevasi Dimostrare) | | |
| ▲ | thaumasiotes 4 hours ago | parent [-] | | CVD seems to be a fairly accurate translation of QED. The Latin is "what was supposed to be shown"¹ and it looks like the Italian means something like "as it was desired to show"? The Italian isn't a relative clause, but the meaning looks basically the same. The Spanish appears to mean something more like "and now, it is shown", which is a completely different meaning expressed with unrelated words that happen to start with the same letters. (Spanish still has direct equivalents of all three Latin words², but I don't think que era demostrando even means anything.) ¹ In an English proof, you might see something like this: "We can then see that a = b < c = d ≤ e, and therefore a < e, which is what we wanted to prove." QED stands for the "what we wanted to prove" part of that, except that there is no we; in the Latin, we simply make reference to the fact that something was supposed to be proven. ² Sticklers might argue that Spanish has lost Latin's quod and replaced it with what is really a descendant of quid. They are almost the same word; quid is an interrogative form. |
| |
| ▲ | eriquesito 5 hours ago | parent | prev [-] | | Isn't it what it literally means in spanish? | | |
| ▲ | racl101 4 hours ago | parent | next [-] | | I think the joke is that while other cultures find Latin to sound esoteric and/or fancy, especially if they had to take courses to learn it, that your garden variety, non-educated, Spanish speaking person just simply gets it cause it's so damn similar to Latin that it doesn't faze them. (Spanish speaker btw). | | |
| ▲ | dmurray 3 hours ago | parent | next [-] | | In English we have this with Rest In Peace. | |
| ▲ | igleria 4 hours ago | parent | prev | next [-] | | ding ding ding correct! | |
| ▲ | thaumasiotes 4 hours ago | parent | prev [-] | | Really? The Spanish words don't seem to bear any relationship to the Latin words, so I fail to see how the relatedness of the languages could be helping. Have you studied Latin, and if not, what does "quod erat demonstrandum" appear to mean to you? |
| |
| ▲ | tancop 3 hours ago | parent | prev [-] | | Not exactly. The Spanish version translates to something like "so it is proved" and is a full sentence, but the Latin is a phrase closer to "which was supposed to be proved". |
|
| |
| ▲ | away0g 5 hours ago | parent | prev | next [-] | | TBD | |
| ▲ | layer8 5 hours ago | parent | prev | next [-] | | You don't say. | |
| ▲ | bell-cot 4 hours ago | parent | prev | next [-] | | Quantum Electrodynamics sounds cooler. | |
| ▲ | bitlax 5 hours ago | parent | prev [-] | | Wow I just thought those were the initials of the guy who wrote every proof ever. | | |
| ▲ | bee_rider 5 hours ago | parent | next [-] | | This would be a good Easter Egg for a story. Mathemystics who worship the ancients, Pythagoras and the mysterious QED. | | |
| ▲ | mikrl 5 hours ago | parent [-] | | Characteristic of the disciples of QED was their renunciation of proper names in favour of a black rectangle. |
| |
| ▲ | mockerell 5 hours ago | parent | prev [-] | | Don’t forget his French cousin CQFD | | |
|
|
|
|
| ▲ | croes 5 hours ago | parent | prev | next [-] |
| > If he says he has Riemann, well then, he has Riemann. That’s not how this works, especially if he works for Anthropic |
|
| ▲ | dmead an hour ago | parent | prev | next [-] |
| surely the incentive structure he has around the anthropic IPO has nothing to do with this. |
|
| ▲ | moralestapia 3 hours ago | parent | prev | next [-] |
| >If he says he has Riemann, well then, he has Riemann. Ugh, I hate it when people want to willingly take us back to the Dark Ages. |
|
| ▲ | racl101 5 hours ago | parent | prev | next [-] |
| Wonder what his intellectual peers think. |
|
| ▲ | jascha_eng 5 hours ago | parent | prev | next [-] |
| I mean a single person can always make mistakes regardless of how smart they are. But this does make it sound a lot more exciting than if a random vibe-prover came up with it. |
| |
|
| ▲ | 5 hours ago | parent | prev | next [-] |
| [deleted] |
|
| ▲ | aaron695 4 hours ago | parent | prev | next [-] |
| [dead] |
|
| ▲ | talon8635 5 hours ago | parent | prev | next [-] |
| You mean, if the AI says it does, than it does. And it’s probably right, because it’s smarter than all of us and we basically just have to trust it now, which is exciting and frighting in many ways. |
|
| ▲ | taegee 5 hours ago | parent | prev | next [-] |
| [flagged] |
| |
|
| ▲ | harry8 5 hours ago | parent | prev [-] |
| [flagged] |
| |
| ▲ | epistasis 5 hours ago | parent | next [-] | | Anthropic? What incident(s) are you talking about? I'm only familiar with OpenAI doing this to a duo, then offering credit only to the non-Anthropic employee. | | |
| ▲ | stymaar 5 hours ago | parent [-] | | the Anthropic employee from the duo in question was the same Levent Alpöge featured here. |
| |
| ▲ | p-e-w 5 hours ago | parent | prev [-] | | Yeah, I’m sure all that stuff was just waiting in some grad student’s notebook. 2.5 Millennium problems solved, ETH disproven, hundreds of other mind-boggling results, but obviously this all just happened because people uploaded their secret breakthroughs to ChatGPT. As a child, I used to laugh at the story of Columbus and his egg, now I get to see it re-enacted in reality! “We could have done the same thing…” | | |
| ▲ | onraglanroad 4 hours ago | parent [-] | | > As a child, I used to laugh at the story of Columbus and his egg I'd never heard of this and I'm in my 50s. I guess it's just not a Scottish story! |
|
|