> LLMs in the end have to operate in natural language concepts and the complexity of natural language is bounded by limits of human cognition.

I don't think this is true.

They have to express themselves as tokens. The meaning of those tokens doesn't have to be text. See any model that can handle images/video. Also, I don't think math, svg, etc, are "natural" language.

And, only the final expression is tokens. The intermediate layers, with the encoded concepts, aren't "natural language".

But, to address your concern (which nobody can disagree with, since even humans can't fully express through text/pictures), potentially: https://news.ycombinator.com/item?id=49758615

▲

_puk 2 hours ago | parent | next [-]

Yeah, as I understand it, natural language is tokenised and vectorised, and then maths takes ahold.

The model isn't limited to concepts that can be expressed in natural language.

It's only once the AI gets to the output layers that natural language comes back into play.

After all, they're all made out of weights[0].

0: https://maxleiter.com/blog/weights

▲

timacles an hour ago | parent | prev [-]

Reality cannot be reduced to tokens

	▲	nomel 30 minutes ago \| parent \| next [-]
		Can it be reduces to ion concentrations? Because that's how we perceive it. A useful perception is all that really matters.
	▲	Dylan16807 an hour ago \| parent \| prev [-]
		Thoughts are a poor reflection of reality to begin with.