It's "dumb" error, but hard to say the model itself if dumb because it does other very hard things so perfectly.

Maybe the model isn't intelligence in any form, except perhaps as an imperfect reflection of the intelligence of its training data.

▲

Isamu an hour ago | parent [-]

I agree, there’s the collective intelligence that created all the content used to train the model. The model is a superposition of all that material with RL tuning. Analogously to reading a book, the intelligence you perceive is from the book’s creator.

	▲	NewJazz 23 minutes ago \| parent [-]
		What about DNA? There are things we do that we never read in a book, maybe never seen someone else do them vefore, but we still do them. Or we still feel a certain way. That doesn't come from "human training data", unless you count the DNA as training data.