Remix.run Logo
MagicMoonlight a day ago

They effectively do. They’re trained by brute forcing 100TB of training data through them, rather than any logical learning technique.

A human doesn’t need 100TB of books to learn the alphabet.

rkomorn a day ago | parent [-]

> A human doesn’t need 100TB of books to learn the alphabet.

A human does need 16ish hours per day of audio/video content for several years to learn the alphabet.

bayindirh a day ago | parent | next [-]

I used a single letter stencil to learn the alphabet, actually, and nobody strapped me to a chair to watch or listen something 16h a day.

Living inside a normal home with my parents was enough for the audio part.

rkomorn a day ago | parent [-]

The 16 hours of audio/video per day was a reference to being alive and hearing/seeing things for years before you actually could learn the alphabet.

It was not meant as literally sitting at a screen with audio/video for 16 hours a day.

bayindirh a day ago | parent [-]

I know, but the density of the data is much less in human case.

IOW, humans still learn more effectively with less information, because there are innate mechanisms which process this data continuously and extract new meanings from the same data. This is part of both intelligence and consciousness.

LLMs lack both.

__turbobrew__ 20 hours ago | parent | next [-]

> I know, but the density of the data is much less in human case.

Is that really the case? How much data is it for 4k video, high bitrate auditory, spacial mapping, internal and external nervous system, emotions, and a dataset to correlate all of these in time?

rkomorn a day ago | parent | prev [-]

> humans still learn more effectively with less information

> because there are innate mechanisms which process this data continuously and extract new meanings from the same data

To me, these statements strongly contradict each other, but I also really do not care enough to debate it.

bayindirh a day ago | parent [-]

I respect your disagreement and desire to leave the debate here. So we can agree to disagree.

Have a nice day.

Betelbuddy a day ago | parent | prev [-]

[flagged]

rkomorn a day ago | parent [-]

I don't listen to Altman. Feel free to take this kind of comment somewhere else.