What does AGI look like in your opinion?

Personally, I've used LLMs to debug hard-to-track code issues and AWS issues among other things.

Regardless of whether that was done via next-token prediction or not, it definitely looked like AGI, or at least very close to it.

Is it infallible? Not by a long shot. I always have to double-check everything, but at least it gave me solid starting points to figure out said issues.

It would've taken me probably weeks to find out without LLMd instead of the 1 or 2 hours it did.

In that context, I have a hard time thinking how would a "real" AGI system look like, that it's not the current one.

Not saying current LLMs are unequivocally AGI, but they are darn close for sure IMO.

> What does AGI look like in your opinion?

Being able to actually reason about things without exabytes of training data would be one thing. Hell, even with exabytes of training data, doing actual reasoning for novel things that aren't just regurgitating things from Github would be cool.

Being able to learn new things would be another. LLMs don't learn; they're a pretrained model (it's in the name of GPT), that send in inputs and get an output. RAGs are cool but they're not really "learning", they're just eating a bit more context in order to kind of give a facsimile of learning.

Going to the extreme of what you're saying, then `grep` would be "darn close to AGI". If I couldn't grep through logs, it might have taken me years to go through and find my errors or understand a problem.

I think that they're ultimately very neat, but ultimately pretty straightforward input-output functions.

If we had AGI we wouldn't need to keep spending more and more money to train these models, they could just solve arbitrary problems through logic and deduction like any human. Instead, the only way to make them good at something is to encode millions of examples into text or find some other technique to tune them automatically (e.g. verifiable reward modeling of with computer systems).

Why is it that LLMs could ace nearly every written test known to man, but need specialized training in order to do things like reliably type commands into a terminal or competently navigate a computer? A truly intelligent system should be able to 0-shot those types of tasks, or in the absolute worst case 1-shot them.