| ▲ | jmalicki an hour ago | |
That makes it not a context window. How to organize code like you said, and how agents interact with it, to keep the actual context window small is the fundamental challenge. | ||
| ▲ | lelanthran an hour ago | parent [-] | |
I keep getting surprised that people who are all-in on this (" i regular execute tasks that require hundreds of subagents ") don't have any idea of what is happening even a single layer below their interface to the LLM ("in practice the context window is effectively unlimited or at least exceptionally high — 100m+ tokens.") I looked at that response by GP (rgbrenner) and refrained from replying because if someone is both running hundreds of agents at a time AND oblivious to what "context window" means, there is no possible sane discourse that would result from any engagement. | ||