| ▲ | agnosticmantis 17 hours ago | |
> If AI is generalising from patterns in latent space, that's a different kind of abstraction How's latent space conceptually different from neuronal activations in our brains? > just as we can't experience latent space directly, Your LLM also doesn't "experience" their activations in the latent space either when generating tokens. I'm not saying LLMs are not conscious/sentient/etc. Just saying if you ask your LLM which activation was stronger that led to a particular solution, they won't be able to answer without using external tools to inspect it. It may just be that LLMs have such a huge context window (short-term memory) compared to humans, that they can process a lot more raw data without having to compress them into theories yet. | ||
| ▲ | teiferer 15 hours ago | parent [-] | |
Human short-term memory and LLM context windows are very different things. More generally, your mental model of how the human brain works seems to be very much aligned with how LLMs work and I would very much caution against that. | ||