Remix.run Logo
PaulDavisThe1st 3 days ago

> I disagree, I may not have the whole codebase in my head in one moment but I have had all of it in my head at some point, and it is still there, that is not true of an LLM.

All 3 points (you have had all of it your head at some point, it is still there, that is not true of an LLM) are mere conjectures, and not provable at this time, certainly not in the general case. You may be able to show this of some codebases for some developers and for some LLMs, but not all.

fnordsensei 3 days ago | parent | next [-]

The brain can literally not process any piece of information without being changed by the act of processing it. Neuronal pathways are constantly being reinforced or weakened.

Even remembering alters the memory being recalled, entirely unlike how computers work.

Lutger 3 days ago | parent | next [-]

I've always find it interesting that once I take a wrong turn finding my way through the city and I'm not deliberate about remembering this was, in fact, a mistake, I am more prone to taking the same wrong turn again the next time.

dberge 3 days ago | parent [-]

> once I take a wrong turn finding my way through the city... I am more prone to taking the same wrong turn again

You may want to stay home then to avoid getting lost.

johnisgood 3 days ago | parent | prev [-]

For humans, remembering strengthens that memory, even if it is dead wrong.

jbs789 3 days ago | parent | prev | next [-]

I'm not sure the idea that a developer maintains a high level understanding is all that controversial...

animuchan 3 days ago | parent [-]

The trend for this idea's controversiality is shown on this very small chart: /

ehnto 3 days ago | parent | prev [-]

I never intended to say it was true of all codebases for all developers, that would make no sense. I don't know all developers.

I think it's objectively true that the information is not in the LLM. It did not have all codebases to train with, and they do not (immediately) retrain on the codebases they encounter through usage.