| ▲ | peri-cl 4 hours ago |
| Terence Tao has some observations that seem to be directed at this, https://mathstodon.xyz/@tao/117237320796901560 > "We have now seen that even the rumor of someone working on a problem can trigger a massive amount of AI-powered effort to flatten it before the original research project has time to reach its full potential. The incentives may now be pointing in the direction of no longer sharing any promising research directions with the broader community, which would reverse centuries of traditions of open science and do serious long-term damage to the future of the field." |
|
| ▲ | vessenes 4 hours ago | parent | next [-] |
| That’s not untrue. But it’s also a misstatement of mathematical history. Many leading mathematicians historically have been highly competitive — Gauss comes to mind. Woe betide the lesser intellect that sent Gauss some ideas. The Newton Leibniz controversy was very serious business at the time in the UK and the continent. It was considered at the least a sin to reveal that sqrt(2) was irrational to those outside Pythagoras circle. Mathematics has always been highly competitive. |
| |
| ▲ | magicalist an hour ago | parent | next [-] | | Surprised to see someone on HN arguing against open science. Seems like the opposite of the lessons we should learn from Newton and Gauss, actually, hoarding results for decades at the expense of progress. (the Pythagorean thing isn't really competition either, is ahistorical, and from what we actually do know it's again people hoarding results instead of sharing them). FWIW, your post comes off as a middlebrow dismissal, surface level and not actually engaging with the substance of the comment. It's also just wrong. You claim "it’s also a misstatement of mathematical history", but don't specify which part. That there's "centuries of traditions of open science"? But your examples are from centuries (and millennia) ago, and there was never any claim that these traditions are universal. But more fundamentally, competition doesn't mean you can't also have open science. And the very long, damaging events like the Leibniz/Newton feud are exactly what make many mathematicians work to maintain a spirit of collaboration and attribution even when they're competing on approaches. | | |
| ▲ | modemNoises 7 minutes ago | parent [-] | | Nothing in their comment reads to me as "arguing against" Reads like nothing but historical context |
| |
| ▲ | kzz102 2 hours ago | parent | prev | next [-] | | The mathematical community was very competitive in its early years, but in the last 70 to 100 years, it has been generally less competitive and very collegial. The community was in a good place, and progress has been very good. In a few cases when competitiveness was ramped up, it lead to bad behaviour and destructive fights. Few would like to return to those competitive years. | |
| ▲ | henryfjordan 3 hours ago | parent | prev | next [-] | | The story of the cubic equations is another great example: https://en.wikipedia.org/wiki/Cubic_equation Dudes straight up used to hoard solutions to equations and use them in math battles. | | |
| ▲ | free_bip 2 hours ago | parent | next [-] | | Right, the point is we're trying to avoid reverting back to such practices. | |
| ▲ | -0_0- 2 hours ago | parent | prev [-] | | Showing my ignorance, but the only thing I can picture when I hear 'math battles' is akin to the 'street Countdown' scene from the IT Crowd |
| |
| ▲ | connorboyle 3 hours ago | parent | prev | next [-] | | My computer contains the prime factorization of probably several dozen (if not more) large integers, and I refuse to share them with anyone! (Because they are my private RSA keys) | |
| ▲ | Jtariiiii 3 hours ago | parent | prev | next [-] | | Also Andrew Wiles working in secret for 7 years out of fear of someone scooping him. | | |
| ▲ | dev_dan_2 3 hours ago | parent | next [-] | | Partially; but also in order to be able to focus, as stated by himself in https://www.pbs.org/wgbh/nova/transcripts/2414proof.html: "But I realized after a while that talking to people casually about Fermat was impossible, because it just generates too much interest, and you can't really focus yourself for years unless you have this kind of undivided concentration, which too many spectators would have destroyed." But yes; him reaping the benefits of himself having the idea first was part of it too; as far as I am aware. ----- Which is still something completely different than some anonymous organisation keeping mathematical research secret because it is better for hype reasons. One is competition between individuals or groups within a field; the other is boring and sometimes borderline nihilistic generating of mathematical knowledge as an marketing asset. | |
| ▲ | techas 3 hours ago | parent | prev [-] | | I've always found the story of A. Wiles sad and frustrating.
He worked in secret for 7 years. He submitted a (incorrect) proof at year 4 or so. Reviewers found a problem, but he decided kept all secret for many years after.
He didn't even proof the last theorem of Fermat directly, he proved some conjeture that someone else before him, proved that it implied Fermat last theorem... I found this behavior against healthy science practices and only driven by ego. Unfortunately, I find this too often at work (working in academia).
Most probably I'm too naive... | | |
| ▲ | Jblx2 18 minutes ago | parent | next [-] | | Obviously, he was trying to avoid being labeled as a crank for working on a famous problem like that for so long. | |
| ▲ | derangedHorse 3 hours ago | parent | prev | next [-] | | While I can sympathize with this perspective, I don’t think it’s right to call it driven by “ego.” Sometimes one just wants to go at a problem without being second guessed on approaches or led astray with suggestions by others. | |
| ▲ | The_Blade 3 hours ago | parent | prev | next [-] | | > He didn't even proof the last theorem of Fermat directly, he proved some conjeture that someone else before him, proved that it implied Fermat last theorem... I think that was Ken Ribet? Grigori Perelman and the Poincaré Conjecture is more interesting. IIRC he turned down Millennium and was decidedly not all about the Fields Medal - mostly because Richard Hamilton didn't get credit? Anyway, I am grateful I had the opportunity to learn about Poincaré in college taking a few classes from a professor who was a key contributor to the conjecture and got a Fulbright for it when I was there | |
| ▲ | rcxdude 2 hours ago | parent | prev [-] | | Eh, it seems like it's pretty necessary for success on such a problem (but obviously not sufficient). These problems gain a reputation, and you either get judged for it or get too much attention for it. |
|
| |
| ▲ | easterncalculus an hour ago | parent | prev | next [-] | | Between people. | |
| ▲ | enraged_camel 4 hours ago | parent | prev | next [-] | | [flagged] | | |
| ▲ | usrnm 4 hours ago | parent | next [-] | | Do you have a real argument to make rather than just appealing to authority? | | |
| ▲ | dev_dan_2 3 hours ago | parent | next [-] | | It is a strong argument in this case though, because Terence Taos expertise is directly linked to his ability to not misstate the history of mathematics. Also note how the quote by Tao is in all likelyhood not meant as an absolute; rather than a statement of a trend - a handfull of counterexamples do I no way change anything about the truth value of Tao's quote. On the other heand; consider how absurd it would be if "... in the direction of no longer sharing any promising research directions with the broader community, which would reverse centuries of traditions of open science ..." would indeed be a misstatement; which would imply that far more promising research directions were not shared with the broader community (i.e.: published). I wonder what different reading of that counterfactual there could be other than secret societies that kept their discoveries and research directions to themselves - which we just learned about (since we would otherwise not be refering to the secret societies and their supposed promising research directions). All pretty straightforward, I would say - both that "misstatement" is hopefully based an overly strict reading of Tao's quote, and that mentioning Tao's background as one of the fields leading practitioners is relevant as well. Again; to make sure: A few counterexamples achieves nothing here. It would need to reach a certain threshold of such counterexamples before we will have to write the history of mathematics; and before Tao actually made a misstatement here. | | |
| ▲ | contravariant 2 hours ago | parent [-] | | I mean mathematics has enough history that something can both have been false for centuries of mathematics research and true for centuries. Sometimes in different places simultaneously. Terrence Tao can do his job perfectly well without being aware of any mathematical history, though I consider it unlikely that he is. I'm not seeing the direct link you're talking about, in fact history is frequently left out of mathematical teaching even when the history would in fact help in the understanding of some concepts. | | |
| ▲ | dev_dan_2 2 hours ago | parent [-] | | > in fact history is frequently left out of mathematical teaching even when the history would in fact help in the understanding of some concepts. That is well-known I assumed and continue to assume. > I'm not seeing the direct link you're talking about You are stating that link yourself; indirectly: "though I consider it unlikely that he is [being unaware of any mathematical history]". Why is it unlikely, precisely? - Maybe because it is unlikely that he recieved the mathematical teaching that frequently does not contain history of mathematics (wild! I wonder which university you have in mind in particular) that you seem to be refering to? - Maybe because his writing is evidence that he is interested about, incorporates and refers to history of mathematics, refer for example to https://terrytao.wordpress.com/2008/01/04/pcm-article-genera... or https://terrytao.wordpress.com/career-advice/theres-more-to-... - Or maybe because he is quite the opposite of a person that never ventures outside of their own area; being blind for other fields, or ones own history; as evidence by being famously collaborative across different fields, having a popular blog where he writes about non-mathematical topics too and last; him being one of the main proponents of foundational topics such as formalization of mathematics; or the use of LLMs for mathematical research. Does all that really make it more likely to you that Tao is not aware of the existence of counterexamples like those the commenter above mentioned - more likely than the commenter simply having missed a nuance or taking something out of context? If so; I would be genuinely curious why - people work differently, and I am always happy to learn, or close gaps in my own understanding. |
|
| |
| ▲ | epestr 3 hours ago | parent | prev | next [-] | | And the other an appeal to tradition. There was only one Gauss to scoop and focusing on him misses the larger math culture which Terry might be aware of, where most trust others to not scoop. And if any mathematician's AI usage on a problem leads to scooping, the volume of agents involved gives them a huge advantage which could prompt mathematicians to not use LLMs. Though you can say Terry's claim is a slippery slope. | |
| ▲ | enraged_camel 3 hours ago | parent | prev [-] | | So let me get this straight: you're saying that Terrence Tao, one of the most prominent mathematicians alive today, doesn't know math history? And me pointing this out is merely an appeal to authority? Get outta here. | | |
| ▲ | nomel 2 hours ago | parent | next [-] | | Soldiers rarely know the history of war, and war historians are rarely soldiers. | | |
| ▲ | magicalist an hour ago | parent [-] | | > Soldiers rarely know the history of war, and war historians are rarely soldiers. I mean, besides the empty platitude that we have no reason to assume applies here, we can easily search and find Tao commenting on the history and philosophy of mathematics. This is a really weird subthread. |
| |
| ▲ | magicalhippo 3 hours ago | parent | prev | next [-] | | Knowing the math that was developed through history, and knowing how that math was developed and the circumstances around it are two fundamentally different things. Clearly Tao knows the former, but apriori that does not imply he knows the latter. Not saying he doesn't, just saying one does not imply the other. Even if you go back and read the original papers, you'll miss all that which happened beyond the page. | |
| ▲ | lo_zamoyski 3 hours ago | parent | prev [-] | | > Terrence Tao, one of the most prominent mathematicians alive today, doesn't know math history? If Tao has a knowledge of the topic (which he does), then it isn't by virtue of being a mathematician per se, but by virtue of an interest in the history of mathematics (which he has). Knowledge of math is enormously helpful here, but it does not imply historical knowledge. |
|
| |
| ▲ | 1w2hagsFa 4 hours ago | parent | prev | next [-] | | [flagged] | |
| ▲ | 4 hours ago | parent | prev [-] | | [deleted] |
| |
| ▲ | 1w2hagsFa 4 hours ago | parent | prev [-] | | [flagged] |
|
|
| ▲ | 20k 2 hours ago | parent | prev | next [-] |
| We're having to rediscover in real time the extremely hard way, why enabling mass theft is so incredibly damaging to society. This is literally why we need a functional copyright system If theft becomes more profitable than genuine creation, then nobody will create anything. Then there's nothing to steal, at which point all progress collapses |
| |
| ▲ | CamperBob2 an hour ago | parent [-] | | This is literally why we need a functional copyright system To block progress. Got it. | | |
| ▲ | 20k an hour ago | parent [-] | | This is the literal opposite of progress: stealing from people genuinely creating, and stealing the money they should earn | | |
| ▲ | CamperBob2 44 minutes ago | parent [-] | | Funny, the stuff that was stolen is still there. A strange kind of theft. Copyright maximalism is a bad look on a site called "Hacker News." Perhaps other sites beckon. |
|
|
|
|
| ▲ | bwfan123 2 hours ago | parent | prev | next [-] |
| It is now clear to me why the AI labs are sponsoring these mathathons: https://mathathonchallenge.com/. They are basically crowdsourcing human researcher data to get access to promising directions possibly later to scoop others. |
| |
|
| ▲ | ozgung 3 hours ago | parent | prev | next [-] |
| No matter what happened this must be a wake up call for all of us. We’re basically sharing everything we have with these companies/AI systems. This is wildly different than a human wiretapping our private messages. Because it is systematic and automated in an astronomical scale. There is no real privacy in this new world. Law? I think “National Security” is a good enough excuse to screen anything constantly, including foreign researchers in case they are close to a breakthrough. |
| |
| ▲ | GolfPopper 3 hours ago | parent [-] | | >We’re basically sharing everything we have with these companies/AI systems. My sense of the word 'share' is that it traditionally involves agency by all parties involved. There are a lot of words in English for describing taking things without permission and profiting thereby - words like piracy, banditry, and larceny. | | |
| ▲ | crisnoble 2 hours ago | parent [-] | | Next you will try to tell me that these companies built upon nothing but piracy, banditry and larceny would continue to commit piracy, banditry or larceny. |
|
|
|
| ▲ | xelxebar 29 minutes ago | parent | prev | next [-] |
| There is also a large incentive for OpenAI to fold user conversations into the training process. Proving this happened is unduly hard, and given that professionals are using frontier LLMs for daily work, such training would make it easier for labs to scoop said professionals. I have seen private correspondence between one mathematician working on Navier-Stokes and OpenAI that makes it sound like OpenAI deliberately scooped this Navier-Stokes result. The alleged correspondence also contained veiled threats if said mathematician went public. |
|
| ▲ | olalonde 3 hours ago | parent | prev | next [-] |
| Isn't it safe to say that all famous unsolved math problems will get a "massive amount of AI-powered effort" pointed at them regardless? |
| |
| ▲ | tzone 3 hours ago | parent [-] | | While AI companies have almost infinite money, they still don’t want to blow million dollar budgets on problems if there isn’t high likelihood that it will be successful. But within next 10 years as costs drop significantly and even more improvements are made, yes it is very likely that almost every single existing math problem will get a serious AI cracking done on it |
|
|
| ▲ | gradus_ad 3 hours ago | parent | prev | next [-] |
| >"While it may be technically infeasible to completely prohibit the use of automated tools to perform indiscriminate solution extraction, I believe that we can still designate many classes of problems as being desirous of a careful analysis that not only solves the problem, but identifies insights from the solution process, and learn more about the difficulty landscape for nearby problems, and for which raw solutions without such analysis would be of negligible or even negative value for these purposes." Not sure I agree with this. AI generated proofs can still be analyzed and mined for useful insights. I suppose he's saying the process of banging our heads against the wall on a problem can itself yield useful insight? But what is stopping us from analyzing a proof after the fact. And if we can generate many different versions of a proof that should help us develop a much deeper understanding of the problem than we would have without being able to perceive the "proof landscape"... |
| |
| ▲ | sobrey 3 hours ago | parent | next [-] | | Not a mathematician. The issue I see with a handed-over proof is tunnel-vision: you explore only the understanding of the proof. Without a proof, your exploration branches out much further, in directions that could seem fruitless, but may uncover new understandings that are now "hidden" because the handed-over proof drastically lowered the incentives to find them. | |
| ▲ | ThrowawayR2 an hour ago | parent | prev | next [-] | | - If you have only a fuzzy idea of how to get to your travel destination, wrong turns and alternate routes may reveal sights and places you'd never have encountered without that wandering. - If your GPS directs you straight to your travel destination, you are now where you wanted to be but missed out on the exploration. This is the sort of consequences the AI math proofs have. STEM research thrives on that side exploration and unearthing unexpected things along the way. James Burke's famous documentary Connections spends the middle episodes talking about the unexpected directions that exploration has taken science. It's very hard to credibly make the case that this sort of meandering exploration is not valuable. | |
| ▲ | cattenwallen 3 hours ago | parent | prev | next [-] | | I think you're misunderstanding the point of math problems. Mathematics is as much a process as it is a result. This is why even from early on, relatively rudimentary mathematics questions you are graded by your capacity to correctly achieve the desired process to the answer than getting the answer correct. The risk here is that AI generated proofs removes the process part of mathematics, where actually interesting concepts live (because then you can apply novel concepts to other unsolved problems and then thereby unlock new concepts that way...) Sure you can kind of try to reverse-engineer it but you lose the entire intuition and "we tried applying it in X, Y, Z ways and it didn't work" intuition, because even the non-working process can teach you about how not to apply the working process to novel problem spaces. Basically: Tasting a delicious soup doesn't tell you how to layer the flavors, but if you want to be a good chef, you better be learning flavors more than you learn dishes! | |
| ▲ | SpicyLemonZest 3 hours ago | parent | prev [-] | | He's saying that in such a scenario, almost all of the value is located in the analysis and just dumping the proof has "negligible or even negative value". (The negative value would occur in the cases where the proof doesn't contain enough information to reconstruct what insights would have led a person to it.) |
|
|
| ▲ | soundworlds an hour ago | parent | prev | next [-] |
| I think this is where people will have to let go of the ego of being the "sole author" of a solution for us to move into the next era of human flourishing. |
| |
| ▲ | samwise99 an hour ago | parent [-] | | The future sole owners of half of San Francisco’s mansions thank you for your enlightened stance. |
|
|
| ▲ | coliveira an hour ago | parent | prev | next [-] |
| This to me is another level of dishonesty. Imagine if a company producing math software starts to hear "rumors" someone is using their software to prove an important result and start massive runs of that software to beat the team. That may not be illegal per se but it is incredibly deceitful. I wonder if the original mathematicians should start a lawsuit for theft of intelectual property. |
| |
| ▲ | pizzly an hour ago | parent [-] | | I would expect this for service providers that provide their "free" services but the mathematicians said they paid OpenAI to help generate this result. This is a clear conflict of interest. Similar to inside trading. Or the same lawyer being hired from two opposing sides which is a big no no. There are rules and laws that already deal with this in other industries and I expect that there will have to be regulation developed for cases where there is a conflict between AI customers and AI provider interest. |
|
|
| ▲ | ltbarcly3 4 hours ago | parent | prev | next [-] |
| I think he's suffering from a sort of static-universe fallacy. People aren't going to keep doing what they are doing, but secretly. What is going to happen is a complete revaluation of things like "finding a counter example to a famous problem". Even if someone finds a solution to a problem like this with pencil and paper, nobody will believe it, and they will assume that there was an AI involved. Further, sitting and doing math with a pencil and paper will no longer be a reasonable strategy to build a reputation or career, beyond the benefit a mathematician gains to their own intuition and skill. People who work hard to build intuition and also use AI effectively will dominate the field. In a world where everyone is using AI, the open problems that remain will be the ones that are AI resistant. This is no different that how things work now, mathematicians wait until they are fairly confident someone won't rapidly solve their problem before they start talking about it. They will do the same thing in the future, except in the future AI will be part of the toolset they use decide if they are ready to share yet or not. Edit: Ok I believe I was generally right here, but I just read the details of what OpenAI did. They didn't solve a longstanding problem, they got tipped off to an approach a mathematician was using and would likely result in the solution very soon and they finished it first. If this turns out to be true I think my take above is not correct, in the short term people will have to stop sharing updates because otherwise openai will dishonestly race to finish their work. |
| |
| ▲ | dev_dan_2 3 hours ago | parent | next [-] | | > If this turns out to be true I think my take above is not correct, in the short term people will have to stop sharing updates because otherwise openai will dishonestly race to finish their work. Which I don't see a reason for Anthropic and "Open"AI not to, given their not so stellar track record with IP of individuals/entities-that-are-not-rich-enough ;) | |
| ▲ | senordevnyc an hour ago | parent | prev [-] | | People who work hard to build intuition and also use AI effectively will dominate the field. This will be literally every field, sooner or later, at least until the human and their intuition is just slowing the AI down. There’s no scenario where humans without AI beat humans with AI in the long run, unless there are fields where the “alien intelligence” somehow hurts more than it helps (like artistic pursuits perhaps?) |
|
|
| ▲ | johnsmith1840 3 hours ago | parent | prev | next [-] |
| I mean, hasn't it always been this way? If something valuable is within reach and you disclose it, someone else might reach for it? Just because the length of the arm is longer with an AI org doesn't mean it's somehow fundamentally a different system. The future is that if you don't use AI your work is a lot easer to reach against someone else who has it. That dude hand writing code with punchcards can be lapped by a 20yo with python, what's different? |
| |
| ▲ | calf 2 hours ago | parent [-] | | The difference is no one writes punchcards so the comparison is inapt. It is more like supposing AI eats everything humans attempt to do. They will take your work as you are working on it, any interaction at all. It is meta-plagiarism, on another level. | | |
| ▲ | johnsmith1840 2 hours ago | parent [-] | | AI didn't "take" anything. An openai researcher did? The solution is also different to theirs? Literally no evidence of plagarism? | | |
| ▲ | opello an hour ago | parent [-] | | No evidence until there's an answer to the question of if prompt data from the other researchers was used to train the internal model. I think the reasonable ethical question to consider when a company has an incentive to prove its value, and learns of the state of the art of a flashy research topic being close to a solution, and then throws loads of resources at trying to solve it first. I agree that "AI" didn't "take" but it's not an incomprehensible shortcut of criticism of the aforementioned behavior, not that precision should be avoided here. | | |
| ▲ | johnsmith1840 an hour ago | parent [-] | | Ok so if no plagarism has occured here in any sense then there's no discussion here? I agree though if they did plagarism it's really really bad for OpenAI. They would instantly have evaporated all remaining good will to gloat over a stolen discovery. | | |
| ▲ | opello 31 minutes ago | parent [-] | | I think there's still an ethical question of a business trying to scoop a researcher solely because the business learned of promising progress. It's not a very big leap to consider "multiple discovery" (a la calculus by Leibniz and Newton) and chance that the model that is good at math proofs might have enough ambient context to work faster from a similar knowledge base on the problem for which promising progress was discovered. I think that's not nice at the very least. Surely the above-board way to approach that is "hey researcher, we learned, indirectly, that you might have made significant progress on flashy research topic and would like the chance to throw our vast computational resources in to try to help work toward the conclusion of that effort." But, maybe that's asking too much? | | |
| ▲ | johnsmith1840 10 minutes ago | parent [-] | | It's a reasonable take. I think there's an important part which is that the nature of the beast implies there's effectively zero way to do that. They have no idea what context, triggering this pathway, was from this guys reddit post 4 years ago. I also assume that if any AI lab could actually do that it'd be an instant pissing context over who gives who credit the mostest. "This software engineer wrote a sick sorting algorthm everyone now uses, thank you random dude for that training contribution" Maybe we will in the future, maybe we'll learn that the solution to this prize is from 3 peoples schizo rant on reddit a decade ago. Would be kinda sick actually. |
|
|
|
|
|
|
|
| ▲ | woodgala 2 hours ago | parent | prev | next [-] |
| It sounds like a fancy way of saying kids will forget how to do math if they use calculators. The flattening of the space makes it hard to find new problems deemed significant? Maybe that went over my head, I’ll concede that point. |
| |
| ▲ | fwip 2 hours ago | parent [-] | | What? No, it's nothing like that. It means that if you have a critical insight and you share it out loud, somebody with no particular mathematical inclination can just spend lots of money to steal the credit from you. It shifts power further from the worker toward those with capital. |
|
|
| ▲ | grog454 an hour ago | parent | prev [-] |
| > We have now seen that even the rumor of someone working on a problem can trigger a massive amount of AI-powered effort to flatten it before the original research project has time to reach its full potential. In other words, the "right" people need to solve it: the mathematicians who made it their job and not the people working to push AI models forward? Struggling to understand how a solution to a millennium problem like this isn't a net positive. Presumably Open AI employs mathematicians in these efforts anyway. And I can think of far worse uses of the AI compute resources. |
| |
| ▲ | magicalist 41 minutes ago | parent | next [-] | | > In other words, the "right" people need to solve it: the mathematicians who made it their job and not the people working to push AI models forward? This is not at all what he said? I'm not sure how you got this from anything he wrote, actually. | |
| ▲ | xmprt an hour ago | parent | prev [-] | | If there are no incentives for mathematicians to work on and share progress in tough problems because they will get scooped, then they will end up quitting and in net we will see less progress overall. | | |
| ▲ | greenowl 38 minutes ago | parent [-] | | Mathematicians can join the club like the rest of us. Time to consider re-training to become a nurse, electrician, auto mechanic, or a plumber. |
|
|