Remix.run Logo
zer00eyz 12 hours ago

The intersection of physics isnt psychology it is philosophy, and the same is true (at present) with LLM's

Much as Diogenes mocked Platos definition of a man with a plucked chicken, LLM's revealed what "real" ai would require: contigous learning. That isnt to diminish the power of LLM's (the are useful) but that limitation is a fairly hard one to over come if true AGI is your goal.

andai 9 hours ago | parent | next [-]

Is it because we haven't invented something better than backpropagation yet?

From what I understand, a living neural network learns several orders of magnitude more efficiently than an artificial one.

I'm not sure where that difference comes from. But my brain probably isn't doing back propagation, it's probably doing something very different.

astrange 5 hours ago | parent [-]

Your brain is doing several different things, because there are different parts of your brain.

(eg different kinds of learning for long-term memory, short-term memory, languages, faces and reflexes.)

quantummagic 8 hours ago | parent | prev | next [-]

What is "contigous" learning, and why is it a hard requirement of AGI?

amelius 12 hours ago | parent | prev [-]

What do you mean by the intersection of physics?

The intersection of what with physics?

zer00eyz 10 hours ago | parent [-]

The intersection of disciplines.

Sir Roger Penrose, on quantum consciousness (and there is some regret on his part here) -- OR -- Jacob Barandes for a much more current thinking on this sort of intersectional exploratory thinking.