Remix.run Logo
hahahaa a day ago

Im not deep into the space but surely zero LLM cost would be default for search???

emilianoc 21 hours ago | parent [-]

In traditional RAG (Retrieval-Augmented Generation), you use an LLM at runtime to read those retrieved documents and synthesize a direct, conversational answer for the user. That generative step is what incurs an API cost and adds latency per query.

RAGless gives you that direct Q&A experience (the synthesized answer) but removes the runtime generation by pre-computing all the answers offline.

hahahaa 11 hours ago | parent [-]

That sounds ... magic. Will give it a go.