Indeed. Any meaningful AGI/ASI will have to have a form of memory / continual learning. Sam Altman said last year that this will be the focus for GPT-6.

The whole "soul.md" stuff today is a poor approximation to that. But I wonder whether it will grow into it, like chain of thought prompting grew into reasoning models.

LLM's as a technology - currently - are stateless. The memory layer is controlled by the agent. I m surprised with the gpt-6 reference unless it has to do with vertical integration between the agent and the layer.