Remix.run Logo
theteapot 2 hours ago

> It helps to know that LLMs don’t “reason”. They predict ..

Semantics. Prediction is the training objective. The ability to reason can be, and very arguably is, an emergent property of that.

complex_pi 34 minutes ago | parent | next [-]

Maybe it looks like reasoning, and maybe that's enough for some.

jayd16 2 hours ago | parent | prev | next [-]

Even if that was true, you'd have to still prove it has emerged.

krackers an hour ago | parent [-]

What would be your test to determine that?

slopinthebag 2 hours ago | parent | prev [-]

Why would "reasoning" be an emergent property of prediction?

hbcdbff 2 minutes ago | parent | next [-]

Why wouldn’t it?

js8 an hour ago | parent | prev | next [-]

There's a lot of reasoning in the training data.

25 minutes ago | parent [-]
[deleted]
mw888 an hour ago | parent | prev | next [-]

Predict multiple outcomes, induct across them, refine.

hsn915 an hour ago | parent | prev [-]

How do you predict without reasoning?

slopinthebag an hour ago | parent [-]

Where is the reasoning in linear regression?

danielbln 39 minutes ago | parent [-]

Where is the reasoning in synaptic transmission?

necovek 5 minutes ago | parent [-]

There isn't, which is exactly the point: we do not yet understand the fundamentals behind reasoning.