Sounds interesting. Can you give more details on your workflow and what tasks you use it for?

Code, creative writing, email summaries, automated email replies, and I prefill my invoice notes and daily updates for work.

Actually built a full invoicing product for that, using it too.

I use Mistral 7b and LlamaIndexTS on Node, I run it on a MacBook M3 and on a Linux server with only 8GB VRAM (old gaming PC).

Basically flawless, runs very fast and I don’t even know what paying for “tokens” is :)