I don't think that the point of the article was "you are dumb if you don't remember absolutely everything".

The point, I believe, was that the more you remember, the better you can think. As in you should strive to remember stuff, and not just be lazy and rely on LLMs. I agree with that.