Remix.run Logo
▲ mewse-hn an hour ago

Interesting write up, I've been vibe coding an android voice assistant using a similar pipeline without a wakeword - VAD > ASR > LLM > TTS

I've found parakeet to be much, much better than whisper and I made a 4 bit quant of parakeet 110M for my crappier android test devices, it would probably fit a raspberry pi:

https://huggingface.co/mewse/parakeet-tdt_ctc-110m-onnx-int4

▲GaggiX 31 minutes ago | parent | next [-]

There is also parakeet-redux, a 1.58bits quant of parakeet-tdt-0.6b-v3 that runs as well as the original model: https://huggingface.co/moondream/parakeet-redux

The model is actually a distillation of a different checkpoint called parakeet-ultra, same size and architecture as parakeet-tdt-0.6b-v3 but better, that's why the 1.58bit quant works so well.

▲mewse-hn 24 minutes ago | parent [-]

Oh crazy I hadn't seen this yet, I might be able to unify my 0.6B vs 110M selector, thanks!

▲nagen an hour ago | parent | prev [-]

[flagged]