Remix.run Logo
Myrmornis 3 hours ago

Sure but the question is why "load" after X?

bigfishrunning 3 hours ago | parent | next [-]

Because, for some high number of contexts, its likelihood comes out high in the big tree of multiplies that is claude's model. For some sets of 500 words (or whatever), the next word is "load". The classifier that decides which sets of 500 (or whatever) words is a prefix for "load" is returning "true" too often.

bunderbunder 3 hours ago | parent | prev [-]

More-or-less the same principle, but scaled up massively, and with context-dependent probability conditioning maps.