This is all lovely and I wish them the best.

But please don't use ollama, or their quants. Not only is the app itself slower than pure llamacpp. But their quants are often no where near the best.

I really hope people start with something like unsloth, as their software and quants are really much better all around.

For anyone who may not be aware it exists: https://unsloth.ai/docs/new/studio

Unsloth has better quants, but when I tried their studio a couple months back it seemed like a buggy mess. Ollama seemed very basic but low-frustration.