Remix.run Logo
▲ imtringued an hour ago

I don't get it. Weights don't change means the model can't learn.

This is not merely an implementation detail, continual learning is the core of AGI.

▲brainwad 21 minutes ago | parent [-]

It means the weights by themselves can't learn. But they could be used in a harness that can learn in other ways. Insisting that it be done at the neural net level seems anthropocentric - because we form memories via neural connections, that everything else must, too.

Also: I wouldn't say a human with amnesia who relied on notes to their future selves lacks intelligence, so I'm not sure being able to form memories is in fact necessary.