You're anthropomorphizing the LLMs, just like most writing from non-technical press, including this article, does.

LLMs do not function very much like human brains, and when you try to map the pieces of an inference system on to human cognitive systems, you're misleading yourself (and maybe others).

An AI as a system can have memory even if some sub-system does not.