Remix.run Logo
fipar 9 days ago

Not the model though. The model really only takes input text and produces output text. Memory within a conversation is achieved by the harness adding the conversation (or parts of it) to the input text. The LLM itself has no memory, it’s the augmented system of several orchestrated LLM calls that does.

nomel 9 days ago | parent [-]

Wait until you hear about the hippocampus!!! [1]

I don't think physical integration within one contained is relevant to system level behavior.

[1] https://en.wikipedia.org/wiki/Neuroanatomy_of_memory

fipar 9 days ago | parent [-]

I had heard (o rather, read) about the hippocampus before, but I don’t understand how that relates to my claim that the models have no memory.

nomel 9 days ago | parent [-]

> The LLM itself has no memory, it’s the augmented system of several orchestrated LLM calls that does

Your own long term memory is the orchestration of systems that make it long term.

fipar 8 days ago | parent [-]

You seem to be arguing as if I'm saying AI can't think or have memory.

Now, my opinion is it currently can't think, but it certainly has memory.

However, LLMs don't have memory. That's what I (and others on this thread) responded to, which is unrelated to how my own memory works.