This is me vibe-splaining something I don't know a lot about, but I doubt there is such a thing.

If "all the knowledge" is what our models now do, what exactly would be the most extreme "none of the knowledge +search" ?

> language specifications.

It would load in all the knowledge to figure it what "language" means, then it would continue trying to decode what "specifications" means.

That might sound absurd, but to figure out the population of New York It's either: Just going to google it, or derive from primary sources.

But how is it ever going to interpret the primary sources? It needs to understand the question, how complex a question is, and how complete an answer is and how things relate. Thats just _too_ much language.

There might be a way to compact this down into a LLM-native language such that the request of `the population of New York` or `use best practices` is encoded without our messy human language for a reasoning model to work with, but the encoding itself has to be done by the "all the knowledge" llm. Now it seems we just rebuild something related to MoE with extra step afaict.