Compared to a 400b model, a 10b is practically useless, it's not even worth bothering outside of tinkering for fun and research.

Still dreaming about an android keyboard that plugs into local or self hosted llm backend for smarter text predictions