| ▲ | GaggiX 31 minutes ago | |
There is also parakeet-redux, a 1.58bits quant of parakeet-tdt-0.6b-v3 that runs as well as the original model: https://huggingface.co/moondream/parakeet-redux The model is actually a distillation of a different checkpoint called parakeet-ultra, same size and architecture as parakeet-tdt-0.6b-v3 but better, that's why the 1.58bit quant works so well. | ||
| ▲ | mewse-hn 24 minutes ago | parent [-] | |
Oh crazy I hadn't seen this yet, I might be able to unify my 0.6B vs 110M selector, thanks! | ||