A new contribution by quite a few prominent authors. One of the better efforts at defining AGI *objectively*, rather than through indirect measures like economic impact.

I believe it is incomplete because the psychological theory it is based on is incomplete. It is definitely worth discussing though.

—-

In particular, creative problem solving in the strong sense, ie the ability to make cognitive leaps, and deep understanding of complex real-world physics such as the interactions between animate and inanimate entities are missing from this definition, among others.

▲

mabedan 16 hours ago | parent | next [-]

I’m surprised there’s no mention of creativity and outside the box thinking. Listening to this podcast I was wondering if we could train the LLM with knowledge cutoff right before transformers, and ask it to come up with an ML method for LLMs. I’m quite sure none of today’s models would be able to (obviously without access to internet search)

▲

kart23 2 days ago | parent | prev | next [-]

I don't know a single one of the "Social Science" items, and I'm pretty sure 90% of college educated people wouldn't know a single one either.

▲

CamperBob2 a day ago | parent [-]

Not only that, but the notion that GPT-5 will answer those questions with only 2% accuracy seems suspect. Those are exactly the kinds of questions that current models are great at.

Nothing about that page makes much sense.

	▲	jonas21 a day ago \| parent [-]
		The percentages are added, not averaged. Each category sums to 10%, and the General Knowledge category has 5 equally-weighted subcategories, so 2% is the best possible score you can get in the social science subcategory. I don't know why they decided to do it this way. It's very confusing.

▲

chrisweekly 2 days ago | parent | prev [-]

I agree it seems like a better-structured effort than many others. But its shortcomings go beyond a shallow and incomplete foundation in psychology. It also has basic errors in its execution, eg a "Geography" question about centripetal and centrifugal forces. Color me extremely skeptical.