By this logic a human is only $130-$160 worth of Oxygen, Carbon, Nitrogen and some trace elements. Perhaps structure sometimes makes things that are more valuable than their inputs?

That said, this is also inaccurate at a technical level.LLM's are very capable of doing math and they ARE calculating internally. Most of what they do is calculation, not storage. It's just not done in a way that it's trivial to explain here.

It's described in some detail below, though it's a bit dense.

https://www.lesswrong.com/posts/E7z89FKLsHk5DkmDL/language-m...