they still have memory, just not new ones - they lived experiences

An LLM’s training could be seen as lived experience, and the fact that LLMs can output long sequences from their training material can be interpreted as them remembering those parts.

Also, how does that relate to consciousness? I don’t think that past episodic memory is necessary for consciousness.