How will we know if its AGI/Not AGI? (I don't think a simple app is gonna cut it here haha)

What is the benchmark now that the Turing test has been blown out of the water?

jltsiren 2 hours ago | parent | next [-]

Until recently, philosophy of artificial intelligence seemed to be mostly about arguments why the Turing test was not a useful benchmark for intelligence. Pretty much everyone who had ever thought about the problem seriously had come to the same conclusion.

The fundamental issue was the assumption that general intelligence is an objective property that can be determined experimentally. It's better to consider intelligence an abstraction that may help us to understand the behavior of a system.

A system where a fixed LLM provides answers to prompts is little more than a Chinese room. If we give the system agency to interact with external systems on its own initiative, we get qualitatively different behavior. The same happens if we add memory that lets the system scale beyond the fixed context window. Now we definitely have some aspects of general intelligence, but something still seems to be missing.

Current AIs are essentially symbolic reasoning systems that rely on a fixed model to provide intuition. But the system never learns. It can't update its intuition based on its experiences.

Maybe the ability to learn in a useful way is the final obstacle on the way towards AGI. Or maybe once again, once we start thinking we are close to solving intelligence, we realize that there is more to intelligence than what we had thought so far.

▲

pixl97 3 hours ago | parent | prev | next [-]

There is a different way I look at this.

Humans will never accept we created AI, they'll go so far as to say we were not intelligent in the first place. That is the true power of the AI effect.

	▲	dimitri-vs an hour ago \| parent [-]
		And yet another way to look at it is maybe current LLM agents are AGI, but it turns out that AGI in this form is actually not that useful because of its many limitations and solving those limitations will be a slow and gradual process.

▲

beej71 2 hours ago | parent | prev | next [-]

I like the line of thinking from an earlier commenter: when an AI company no longer has any humans working, we'll know we're there.

▲

jobs_throwaway 3 hours ago | parent | prev | next [-]

Supranormal GDP growth is my bar. When its actually able to get around bottlenecks and produce value on a societal level

▲

esafak an hour ago | parent [-]

An agent need not have wants, so why would it try to increase its efficiency to obtain things?

▲

hi_hi 37 minutes ago | parent [-]

I don't think that was the intent of the comment, more that true AGI should be so useful and transformative that it unlocks enough value and efficiencies to boost GDP. Much like the Industrial Revolution or harnessing electricity, instead of a fancy chatbot.

▲

esafak 26 minutes ago | parent [-]

Increased productivity is not equivalent to intelligence.

	▲	hi_hi 14 minutes ago \| parent [-]
		No one said it is. Sometimes correlation does equal causation.

▲

lostmsu 3 hours ago | parent | prev [-]

To my knowledge Turing test has not been blown out of the water. The forms I saw were time limited and participants were not pushed hard to interrogate.