Remix.run Logo
▲ riknos314 15 hours ago

Individuals don't store memories as language, but language is the unit of portability between individuals.

I'm skeptical that there's a medium better than language that's portable between models. Would love to be proven wrong since the solution would likely be fascinating.

Any system where a memory written by an opus orchestrator isn't available to a sonnet implementor doesn't seem particularly useful to me, so portability is important.

▲grey-area 8 hours ago | parent [-]

There are significant problems with text files for memory though - context length, memories conflicting with base weights and with each other. Memories not always being considered and forgotten because they’re in context rather than from training weights.