| ▲ | mewse-hn an hour ago | |||||||
Interesting write up, I've been vibe coding an android voice assistant using a similar pipeline without a wakeword - VAD > ASR > LLM > TTS I've found parakeet to be much, much better than whisper and I made a 4 bit quant of parakeet 110M for my crappier android test devices, it would probably fit a raspberry pi: https://huggingface.co/mewse/parakeet-tdt_ctc-110m-onnx-int4 | ||||||||
| ▲ | GaggiX 31 minutes ago | parent | next [-] | |||||||
There is also parakeet-redux, a 1.58bits quant of parakeet-tdt-0.6b-v3 that runs as well as the original model: https://huggingface.co/moondream/parakeet-redux The model is actually a distillation of a different checkpoint called parakeet-ultra, same size and architecture as parakeet-tdt-0.6b-v3 but better, that's why the 1.58bit quant works so well. | ||||||||
| ||||||||
| ▲ | nagen an hour ago | parent | prev [-] | |||||||
[flagged] | ||||||||