> Humans also work because they've been trained on a massive corpus of materials,

Massive? My introduction to programming (from noob to beginner level) has been like only 10 books worth of content. Including some alternative pathways like 3D, security, system administration,... To this day, I don't think I've reached 50 books of materials. And If I counted everything it would be still small.

Human learning is very efficient (not time wise, but cost wise, and even training data wise).

▲

skeledrew 2 hours ago | parent | next [-]

You're forgetting all the schooling before that, which taught you how to read, do math, etc. And the general daily experiences of just being a human being interacting with the world. Magnitudes more data taken in than any language model.

▲

DonaldPShimoda 2 hours ago | parent [-]

> Magnitudes more data taken in than any language model.

Ah, yes, I can fondly recall reading and internalizing every word available on the internet when I was young...

▲

skeledrew 2 hours ago | parent | next [-]

You should check out how much raw data just your eyes process for every second they're open (although a significant amount is discarded before it gets to the vision center, but still). Then consider the other senses also constantly doing their thing.

	▲	LoganDark 2 hours ago \| parent [-]
		The vast majority of people don't internalize most things. Some internalize even less. It can become a big issue with things like dissociative disorders. (I have some experience with that)

▲

nvme0n1p1 2 hours ago | parent | prev [-]

A picture is worth a thousand words. How much video data was your brain trained on?

▲

senordevnyc 2 hours ago | parent | prev [-]

Only if you ignore the billion years of pretraining…