So there are a zillion of these, including ones that do what yours does. But that being said, I'm going to always upvote every single one of them because this is better and more important that what the big companies are doing across the board.

▲

jrm4 an hour ago | parent | next [-]

Fwiw, I'm liking the koboldcpp "ecosystem", including koboldlite; basically it's letting me try a little of everything, though there may be something of a "jack of all trades master of none" thing going on. But it has these nice little presets for, e.g. llms, voice, music, images, a "chatgpt"-esque interface, etc.

▲

pancomplex 3 hours ago | parent | prev [-]

Thank you! Would love to hear which ones you've used. Working with local files without anything going to the cloud was the main thing I wanted. I tried Jan, OpenWork, Chatbox and Lobe, and couldn't get that working well in any of them. If there's one I missed it would be great to check it out!!

	▲	prophesi 3 hours ago \| parent \| next [-]
		Have you tried Open WebUI? It doesn't determine which model works best for your hardware, but it otherwise has a very large feature set with a large community, and runs offline by default. Geared more for technical users, however.
	▲	l3x4ur1n 2 hours ago \| parent \| prev \| next [-]
		I am using Hermes and I did not try charts, but the rest it can do with ease. And I use DeepSeek flash API as a driver most of the time.
	▲	fmxexpress 3 hours ago \| parent \| prev \| next [-]
		In PasClaw, I specifically built it to do local embedding and other local only functionality. Whether it works well or not yet is another story.
	▲	universenz 3 hours ago \| parent \| prev \| next [-]
		Definitely check out Osaurus for macOS and Windows. Heavily privacy focused with e2ee iOS and iPadOS tethers.
	▲	ajvs 3 hours ago \| parent \| prev [-]
		Orca works great.