Remix.run Logo
summarybot 5 hours ago

It's a very good observation. I don't know if I'd call it "forgetfulness" in the context of a current [2026 edition] LLM. They are very good at remembering almost every "thing" that passes a certain token-density threshold, until they hit saturation, and then it's a sheer rockface down to the abyss of unnatural hedging and reconfirmation of basic premises. Some sort of "forgetfulness" as described would introduce more moving parts into the "inference" stage of the running of an LLM, introducing statefulness/state-tracking.

tejassuds 5 hours ago | parent [-]

[flagged]