Remix.run Logo
hnaccount_rng 4 months ago

But that resonance is a form of surprise. You are just using different words for the same context. At the same time: You are correct in the sense, that this "surprise" is completely ignored by today's LLMs. They only use this in training mode and not for continuous learning. Whether one can find a sufficiently useful definition of "surprise" to use auxiliary "learning systems" (vector DBs or system prompts) has yet to be shown