Remix.run Logo
petilon 3 hours ago

Here's another definition of AGI from Sam Altman:

https://www.nytimes.com/2023/11/20/podcasts/hard-fork-sam-al...

Sam Altman: Let’s say we make an A.I. that is really good, but it can’t go discover novel physics. Would you call that AGI?

Kevin Roose (New York Times): I probably would, yeah. Would you?

Sam Altman: Well, again, I don’t like the term, but I wouldn’t call that done with the mission.

hackerbrother 2 hours ago | parent | next [-]

If the new AGI benchmark is "be Einstein/Feynman" then we've hit AGI.

jmalicki an hour ago | parent | next [-]

What if it can be Einstein, but can't draw a Pelican, write a solid college-level essay, or fold clothes?

The ability to do a ton of book learning in training, and pull in tons of related context at once, is superhuman in some ways, but lags a lot in others.

AareyBaba 22 minutes ago | parent | next [-]

Folding clothes is happening. https://www.youtube.com/watch?v=cRZNwgvcWUg

AI in math is ongoing. https://spectrum.ieee.org/ai-in-mathematics

vel0city 5 minutes ago | parent | prev | next [-]

How good was Einstein at drawing pelicans on bicycles by writing SVG code?

Checkmate, meatbags.

CamperBob2 19 minutes ago | parent | prev [-]

Pelicans are a solved problem at this point. An open-weight model on my own machine gave me this: https://crimson-jeri-74.tiiny.site/

And the only reason LLMs can't write essays indistinguishable from human output is because they aren't RLHF'ed to write like humans.

Folding clothes isn't an LLM's job but if you were to insist, they could certainly do it, as any number of videos from robotics labs will attest. That particular future is already here but definitely not evenly-distributed.

block_dagger an hour ago | parent | prev [-]

Wouldn’t that mean producing novel work like relativity and QED?

jmalicki an hour ago | parent [-]

I would maybe argue that Einstein was the most LLM-like of great thinkers.

A lot of his great discoveries were mostly that he was very knowledgeable about the bleeding edge research in a number of disparate areas, and was able to have the aha moment where he could make the connections for how to integrate them.

A lot of other thinkers who created new fields from scratch are probably way harder for an LLM to crack.

That is very aligned with an LLMs ability to have superhuman knowledge in wide areas.

throwawayq3423 3 hours ago | parent | prev [-]

What is novel physics?

astro1234 3 hours ago | parent | next [-]

I think they mean improve our understanding of physics with new theoretical results or paradigms. Like if it’s 1899, would Astra develop General and Special relativity on its own?

glenstein an hour ago | parent | next [-]

This is as good a time as any to note that we might be closing in on a new conceptual revolution in our own time as it relates to holography and an information centric approach to spacetime. Obviously It's the furthest possible thing from a guarantee, but it has much of the enthusiasm and motivation that string theory had previously enjoyed in prior decades.

So it could be a natural experiment for whether AI can contribute to novel physics. Specifically, there's a big question about weather. Something like our informational understanding of black holes where information inside it is equivalent to information on its boundary (which I'm sure I'm not saying correctly), might be generalized to regular space-time. More people should be freaking out with excitement about this and perhaps it's something to which AI can contribute.

adastra22 2 hours ago | parent | prev | next [-]

There was symbolic AI programs in the 1980’s that “discovered” Kepler’s laws and the resulting solar system model from just tycho brache’s astronomical observations. That was the the very first “new physics” ever.

verelo 2 hours ago | parent | prev | next [-]

i wonder if we could train a modal, and omit all data prior to 1899, and see what happens?

astro1234 an hour ago | parent [-]

Do you mean after? People do this!! But I think it’s a bit different. It won’t be apples to apples because the data volume I think is just so much different. Maybe there are good experiments for something like this.

ShinyLeftPad an hour ago | parent | prev [-]

as always, as good as its prompt...

senderista 3 hours ago | parent | prev [-]

I assume solving one of the major open problems of physics?

adastra22 an hour ago | parent | next [-]

That’s already been done. I know of at least one novel result contributed by Claude to frontier physics. I’m sure there is more.

type_enthusiast 2 hours ago | parent | prev | next [-]

Would this be possible without it being able to run novel real-world physics experiments autonomously?

(Note: I am not suggesting we let it do this. Please don't, in fact)

petilon 2 hours ago | parent | next [-]

AI could discover candidate novel physics without autonomously operating new physical experiments, and humans or instruments can later independently validate the result. This is analogous to how Einstein developed theories whose predictions were confirmed by experiments and observations only years or decades later.

auntienomen an hour ago | parent [-]

Do we have any examples of an current day AI system introducing a novel concept or perspective. We've got plenty of counterexamples discovered and some theorems proven, but afaik nothing analogous to a new definition.

adastra22 2 hours ago | parent | prev [-]

Why not?

colordrops 2 hours ago | parent | prev [-]

For it to be like a human it wouldn't just need to solve existing phsyics problems, it would need to push the field forward and introduce new paradigms.

petilon 2 hours ago | parent [-]

Solving "open problems" will push the field forward.