▲ | martzoukos a day ago | |||||||
I guess that there is no streaming option for sending generated tokens to, say, an LLM service to process the text in real-time. | ||||||||
▲ | nomad_horse a day ago | parent [-] | |||||||
Whisper has the encoder-decoder architecture, so it's hard to run streaming efficiently, though whisper-streaming is a thing. https://kyutai.org/next/stt is natively streaming STT. | ||||||||
|