Should we even be storing 'memories' in text files at all?

Imagine how humans would function if we carried our memories around in overflowing notepads and had to consult them every time we wanted to know a fact or remember a person we had met, it would be exhausting and inefficient.

▲

riknos314 14 hours ago | parent | next [-]

Individuals don't store memories as language, but language is the unit of portability between individuals.

I'm skeptical that there's a medium better than language that's portable between models. Would love to be proven wrong since the solution would likely be fascinating.

Any system where a memory written by an opus orchestrator isn't available to a sonnet implementor doesn't seem particularly useful to me, so portability is important.

	▲	grey-area 7 hours ago \| parent [-]
		There are significant problems with text files for memory though - context length, memories conflicting with base weights and with each other. Memories not always being considered and forgotten because they’re in context rather than from training weights.

▲

Muromec a day ago | parent | prev [-]

It would be nice if local models will unlock the way to put memories back into the model itself somehow, but it's not big labs who would bake something useful here I'm afraid.