The thing is why would forgetting even matter if the AI can just remind you of anything that you forgot?

Remembering and understanding aren't the same thing. Merely reciting facts doesn't automatically give you the ability to apply those facts to solve problems.