Good thoughts here. Forgetting is important, but that's too advanced for modern LLMs.