Remix.run Logo
▲ solyin 20 hours ago

It generalizes reasoning. If we are to believe the link's linked paper, that's new. It didn't exist before. Yes a human helped. AI also played a part. Somewhere in the calculation of a pile of linear algebra, gigabytes, upon gigabytes of training data and RAM, whilslt still predicting the next token, the prediction that went into choosing that specific next token, reasoning occured.

Internal to the model, it can represent intermediate relationships, combine them, and then use those results to generate a unique answer.

▲soon_to_be_sb 18 hours ago | parent [-]

> into choosing that specific next token, reasoning occured.

This is where you fall.

Imagine when you ask an LLM, "can cats fly", it reply "No".

But then, you can feed it so much fake training data based on this specific question so that it will say "Yes" to this question, despite all the genuine training data it had before that point.

You won't be able to teach a reasoning entity such contradicting facts. There is no mechanism in the LLM to reject fake data that contradicts with its existing knowledge.

So an actual intelligent entity should curate the training data first, for the LLM to show the "appearance" of intelligence.

▲preg_match 18 hours ago | parent | next [-]

No, LLMs can reason. If you ask it to explain how and why cats can fly, it will show its reasoning. It’s not a secret. You can try to convince it otherwise, and of course if you poison the data that will affect it.

But then it will realize… well most mammals don’t fly. And cats don’t have wings. So no, cats cannot fly. That’s rudimentary reasoning that a child could probably do, but it’s reasoning. You can try the same experience with a human child. Tell them over and over if cats can fly. They might then say yes! Then ask them to explain how, and they’ll reason and decide no, they cannot.

Of course LLMs can do reasoning much more advanced than that, as evidenced by theorem proving.

▲Planktonne 9 hours ago | parent [-]

> No, LLMs can reason. If you ask it to explain how and why cats can fly, it will show its reasoning

You're eliding an important difference here.

> can reason...show its reasoning

The appearance of a thing is not necessarily the same as the thing.

▲lostmsu 5 hours ago | parent [-]

Yesterday GPT 6 wrote a new joke. Same day world famous comedian came up with a word for word the same joke independently. Except his joke was funny!

▲Planktonne 2 hours ago | parent [-]

The argument would be stronger if you had a real example rather than a made-up one.

▲solyin 13 hours ago | parent | prev | next [-]

> "On two occasions I have been asked, 'Pray, Mr. Babbage, if you put into the machine wrong figures, will the right answers come out?' In one case a member of the Upper, and in the other a member of the Lower, House put this question. I am not able rightly to apprehend the kind of confusion of ideas that could provoke such a question."

- Charles Babbage, 1864 memoir, Passages from the Life of a Philosopher

▲solyin 12 hours ago | parent | prev [-]

We tell children stories of Santa and they believe their parents. Are children merely the appearance of intelligence as well?