The problem of overflowing context is solved by RAGs, though.

> The problem of overflowing context is solved by RAGs, though.

No, it isn't.

It's mitigated with RAGs, but RAGs add to the context, and what they add might be irrelevant is all the retriever module is doing is plain text search.

If the retriever module is performing an embeddings/vector search on a properly prepared dataset you may have more luck, but it's still a piss-poor experience compared to simply putting all the tools into the context.

Of course, I'm not an expert, so I welcome corrections.

RAG mitigates somewhat the problem of insufficient context, it does not solve it.