Remix.run Logo
apsurd 2 hours ago

Isn't a large context window still a problem though? At the upper bound, the more you put in the more each sentence washes out within that window?

whstl 2 hours ago | parent [-]

I’m not talking about large amounts of text, I’m talking about a couple sentences back and forth.

It disregards things like “no follow up questions”.

Haiku, for example doesn’t.

This bias is a very human thing, actually now that I think about it. You just disregarded the “even if the messages are just a few characters long”. :)

apsurd an hour ago | parent [-]

haha! yes i read too fast but i did read it and i took "message is small" to mean the message you want followed within the large context, not the entire context is just a small message.

funny though it is a case in point: language is hard. and i get to hide behind being "preoccupied" . i wonder if llms have their own sense of preoccupation hmmm.