| ▲ | thevalueisai 6 hours ago |
| The value is proving AI can be useful after all (and we're fucked). Remember, not too long ago we had hordes of folks here proclaiming machines can't think, reason or be creative in any productive sense. Many still do, but it's starting to look bleaker by the day. |
|
| ▲ | agentultra 5 hours ago | parent | next [-] |
| This is a competent person using a tool in their work. The tool isn’t doing the thinking or the proof on its own. It also hasn’t been vetted/verified yet. There’s still work to do. |
| |
| ▲ | 5 hours ago | parent | next [-] | | [deleted] | |
| ▲ | 0c3ca83 3 hours ago | parent | prev [-] | | What were the prompts? For many of the proofs coming out of the AI companies where the prompts were posted, they ended up being variants of "solve the problem", "keep going", "I believe in you". Many of the results could have come from a 15 year old that heard of the problem in passing. The result here is a quarter of a million pages. Human involvement is going to be minimal. | | |
| ▲ | what 2 hours ago | parent [-] | | If you believe these were the prompts, I’ve got a bridge to sell you. |
|
|
|
| ▲ | ThrowawayR2 5 hours ago | parent | prev | next [-] |
| These AI bros don't get it. These LLM systems solving math problems have the benefit of being constrained by formal rules of math providing constant feedback when they break the rules that prevents them from wandering into la-la land. As Dijkstra said in his prescient "On the Foolishness of 'Natural Language Programming'": > "The virtue of formal texts is that their manipulations, in order to be legitimate, need to satisfy only a few simple rules; they are, when you come to think of it, an amazingly effective tool for ruling out all sorts of nonsense that, when we use our native tongues, are almost impossible to avoid." To whatever extent that LLMs can "think, reason, or be creative" in generating these proofs (or writing code), they're aided by very high guardrails so it doesn't say very much about what they can do in broader, fuzzier domains. |
| |
| ▲ | randomNumber7 2 hours ago | parent | next [-] | | Goedel proofed that you can formulate nonsensical statements in math (and any formal system that is complex enough to be useful) | | |
| ▲ | ThrowawayR2 2 hours ago | parent [-] | | Gödel proved that statements can be created that are definitely true or false but for which no proof can be constructed. It is not relevant here since proofs are successfully being constructed, according to checking using Lean, by an LLM. |
| |
| ▲ | brookst 4 hours ago | parent | prev [-] | | Would you say that the early results of AI beating humans at backgammon and checkers had any predictive power towards chess and go? | | |
| ▲ | ThrowawayR2 3 hours ago | parent [-] | | The kind of AI used for backgammon/checkers and the kind of AI used for chess/go, and LLMs differ greatly so I'm not sure what the point of your question even is. A casual check says that the state of the art LLMs have much lower [EDIT]Elo ratings for checkers than the purpose built "AI" that beat humans. | | |
|
|
|
| ▲ | ToucanLoucan 5 hours ago | parent | prev [-] |
| > Remember, not too long ago we had hordes of folks here proclaiming machines can't think Machines can absolutely think. It's really all they do. > reason Murky, but LLMs prove with an avalanche of statistical modeling, they can do something kind of analogous to reasoning, with the caveat that whatever they output will necessarily have to exist in some fashion in their training data. > or be creative Absolutely not. By definition an LLM cannot create original work, it can only remix and recombine what it already knows. That can be interesting, and bloody useful especially for code tasks, but it is not making anything original. |
| |
| ▲ | retsibsi 5 hours ago | parent | next [-] | | > Absolutely not. By definition an LLM cannot create original work What (if anything) unambiguously counts as original work, according to this definition? | | |
| ▲ | ToucanLoucan 5 hours ago | parent [-] | | Arguing the definition of original is pointless for the exact reason you point out: that it's ambiguous. Due to the nature of how an LLM works, it cannot make anything truly new, it, again, can only recombine and remix things from it's training data. This is why AI images/writing are so easily spotted, and even AI code to a degree: they have a distinct "style" as a consequence of how they work. I leave what is truly original to the philosophers. What I can say for certain, is that anything you get out of any of these models is a remix of what is present in it's training data, because gravity exists and energy is conserved. They are not intelligent, they are not conscious, and they cannot make New things. | | |
| ▲ | retsibsi 5 hours ago | parent | next [-] | | > What I can say for certain, is that anything you get out of any of these models is a remix of what is present in it's training data, because gravity exists and energy is conserved. But doesn't that same argument apply to humans, where 'training data' = all our sensory inputs (plus what's encoded in our DNA, depending on whether we want to analogise that to the training data or the underlying architecture)? > Arguing the definition of original is pointless for the exact reason you point out: that it's ambiguous. I'm not trying to be a smartarse here but you are the one who is claiming absolute certainty that something is false 'by definition', so I think the onus really is on you to have a precise definition in mind. > They are not intelligent, they are not conscious, and they cannot make New things. I'm not a consciousness denier or anything, in fact I think it is the most important thing in the world, but I don't understand the connections you're making here. 'Intelligent', like 'original', can be defined and needs to be defined for this statement to be meaningful. 'Conscious' is probably inherently slippery, but if we mean the same thing by it (having subjective experience/qualia) then I have no idea how you could be certain that any other entity lacks it. And it seems like you may be implying that consciousness is a necessary condition for originality, but I don't think you've explained how. | |
| ▲ | jonahx 4 hours ago | parent | prev | next [-] | | > Due to the nature of how an LLM works, it cannot make anything truly new, it, again, can only recombine and remix things from it's training data Fwiw, David Hume made this exact argument about human imagination: > But though our thought seems to possess this unbounded liberty, we shall find, upon a nearer examination, that it is really confined within very narrow limits, and that all this creative power of the mind amounts to no more than the faculty of compounding, transposing, augmenting, or diminishing the materials afforded us by the senses and experience. [David Hume — An Enquiry Concerning Human Understanding (1748), Section II, Paragraph 5] | |
| ▲ | WarmWash 4 hours ago | parent | prev | next [-] | | Everything is either deterministic, random, or a mix of that. New is just a mix of deterministic and random. LLMs are not deterministic. You don't even need an LLM to create something new and improved. Evolutionary algorithms have been doing it since the 80's. | |
| ▲ | hardbass 4 hours ago | parent | prev | next [-] | | Non answers are best ignored. You have failed to define what creativity is and therefore failed to prove whether llms are "creative" or not. What exactly are you trying to say about gravity and thermodynamics? You may be confused but these are universal physical laws that apply to everything, humans, computers, anything else. At its most basic level if I had to start with defining creativity, it should be some kind of intelligent filtering process. The brain can be in a huge number of state configurations, the interesting and novel among them are "creative" ideas. We can build upon it further. I am happy to say I am no philosopher and I will defer to those with expertise on it. But if you don't have any definition for it, its quite strange to make up some beliefs about it without proof. | |
| ▲ | drdeca 4 hours ago | parent | prev | next [-] | | You’re the one who said “ By definition an LLM cannot create original work”, so I think responding asking for the definitions you are talking about is quite justified? Often when someone says that something is true by definition, their claim is incorrect. | |
| ▲ | 4 hours ago | parent | prev | next [-] | | [deleted] | |
| ▲ | brookst 4 hours ago | parent | prev | next [-] | | Does your same argument hold for humans’ inability to do more than remix? Gravity exists and energy is conserved for us, too. | |
| ▲ | CamperBob2 4 hours ago | parent | prev [-] | | Arguing the definition of original is pointless for the exact reason you point out: that it's ambiguous. Well, it certainly wasn't "ambiguous" two posts ago when you said "Absolutely not. By definition an LLM cannot create original work." Make up your mind. You've been beating this drum since roughly GPT 3.5, as I recall. Your goalposts aren't even on the field anymore, they're gathering dust in a far corner of the parking garage down the street from the stadium. Time to update your priors. |
|
| |
| ▲ | haickernews 4 hours ago | parent | prev | next [-] | | If you can be persuaded, looking into how modern LLMs are trained with reinforcement learning may change your views. | | | |
| ▲ | squidmaster 4 hours ago | parent | prev [-] | | [dead] |
|