Remix.run Logo
▲ bityard 4 hours ago

There are a fair number of people who seem to believe that LLMs contain "world knowledge" and are blissfully unaware of how inaccurate an ungrounded chatbot can be. They ask it questions, it gives them confident and plausible (sometimes even correct!) answers, and they leap to the conclusion that these are useful tools for end-of-civilization knowledge bases. I fought this battle countless times on HN and Reddit, generally unsuccessfully.

This project at least attempts to ground its answers with (presumably) human-vetted sources. That will make it much, MUCH more accurate and truthful than a bare model. But there is still a non-zero chance for it to hallucinate answers, especially when posed a question that it doesn't have any source material in its database.

As for why bother hooking up an LLM instead of a simple search engine, search engines don't synthesize data from multiple sources into a coherent answer for you, but LLMs are (mostly) great at that.

That said, while I like this pattern (LLM + knowledge base) for lots of things, this isn't necessarily something I'd trust with my own (or my family's) survival.