Remix.run Logo
prophesi 2 days ago

I think RAG is out of favor because models have a much larger context these days, so the loss of information density from vectorization isn't worth it, and doesn't fetch the information surrounding what's retrieved.

simonw 2 days ago | parent [-]

That's true if you use RAG to mean "extra context found via vector search".

I think vector search has shown to be a whole lot more expensive than regular FTS or even grep, so these days a search tool for the model which uses FTS or grep/rg or vectors or a combination of those is the way to go.