Yes, I should have clarified that I was referring to memory of training data, not of conversations.
Training data also deteriorates quite quickly as the context gets longer.