Remix.run Logo
vrotaru 3 days ago

Sorry for harping on it, but I think this clearly reflects the difference between 2 approaches to storing knowledge, lossy but humongous, and lossless but limited.

LLMs - Lossy highly compressed knowledge which when prompted "hallucinates" facts. LLMs hallucinations are simply how the stored information is retrieved.

Memory (human in this case) - Extremely limited, but almost always correct.

Just an observation. No morals.

shahar2k 2 days ago | parent [-]

honestly humans are nowhere near as lossless as you think, look up any study on eye-witness acounts of crimes and you will see how fallible to hallucination the human mind is as well .... at least when it comes to one-shot learning.

I feel from my own experience teaching, that it's repetition and pruning of information that really makes human memory and learning much more effective and not the act of storing the information the first time.