The primary source is: measured LLM performance on once-human-exclusive tasks - such as high end natural language processing or commonsense reasoning.

Those things were once thought to require a human mind - clearly, not anymore. Human commonsense knowledge can be both captured and applied by a learning algorithm trained on nothing but a boatload of text.

But another important source is: loads and loads of mech interpret research that tried to actually pry the black box open and see what happens on the inside.

This found some amusing artifacts - such as latent world models that can be extracted from the hidden state, or neural circuits corresponding to high level abstracts being chained together to obtain the final outputs. Very similar to human "abstract thinking" in function - despite being implemented on a substrate of floating point math and not wet meat.

▲

freejazz 5 days ago | parent [-]

I haven't seen LLMs perform common sense reasoning. Feel free to share some links. Your post reads like anthropomorphized nonsense.

▲

keeda 5 days ago | parent | next [-]

One of the most astonishing things about LLMs is that they actually seem to have achieved general common-sense reasoning to a signficant extent. Example from the thread about somebody ordering 18000 waters at a drive-through: https://news.ycombinator.com/item?id=45067653

TL;DR: Even without being explicitly prompted to, a pretty weak LLM "realized" that a thousand glasses of water was an unreasonable order. I'd say that's good enough to call "common sense".

You can try it out yourself! Just pick any AI chatbot, make up situations with varying levels of absurdity, maybe in a roleplay setting (e.g. "You are a fast food restaurant cashier. I am a customer. My order is..."), and test how it responds.

▲

ACCount37 5 days ago | parent | prev [-]

What? Do you even know what "commonsense reasoning" means?

▲

freejazz 5 days ago | parent [-]

Do you?

▲

ACCount37 5 days ago | parent [-]

https://en.wikipedia.org/wiki/Commonsense_reasoning

▲

freejazz 5 days ago | parent [-]

So, you don't, but wikipedia does? I'll believe they can do commonsense reasoning when they can figure out that people have 4 fingers and 1 thumb. Here I was thinking common sense reasoning was what we call reasoning based on common sense. Go figure some AI folks needed to write a wikipedia article to redefine common sense.

Like they say, common sense ain't so common at all.

▲

ACCount37 5 days ago | parent [-]

Least you could do is look up what an unfamiliar term means before rolling in with all the hot takes.

So take the link, and read it. That would help you to be less ignorant the next time around.

	▲	freejazz 5 days ago \| parent [-]
		>Least you could do is look up what an unfamiliar term means before rolling in with all the hot takes. Thanks for proving my point that common sense ain't so common. To be clear, common sense reasoning is not an "unfamiliar term" save for this new (article was written in 2021) redefinition of it to be something AI related. It's kinda laughable that you are being this snitty about. > That would help you to be less ignorant the next time around. Better to be "ignorant" than slow and humorless.