Remix.run Logo
mrkeen 10 hours ago

Any tips on local/enterprise search?

I like using ollama locally and I also index and query locally.

I would love to know how to hook ollama up to a traditional full-text-search system rather than learning how to 'fine tune' or convert my documents into embeddings or whatnot.

ineedasername 10 hours ago | parent | next [-]

You can use solr, very good full text search and it has an mcp integration. That’s sufficient on its own and straightforward to setup:

https://github.com/mjochum64/mcp-solr-search

A slightly heavier lift, but only slightly, would be to also use solr to also store a vectorized version of your docs and simultaneously do vector similarity search, solr has built in knn support fort it. Pretty good combo to get good quality with both semantic and full-text search.

Though I’m not sure if it would be relatively similar work to do solr w/ chromadb, for the vector portion, and marry the result stewards via llm pixie dust (“you are the helpful officiator of a semantic full-text matrimonial ceremony” etc). Also not sure the relative strengths of chromadb vs solr on that- maybe scales better for larger vector stores?

all2 10 hours ago | parent | prev [-]

docling might be a good way to go here. Or consider one of the existing full text search engines like Typesense.