| ▲ | fragilerock 3 hours ago | |
Interesting read! I have my own local voice assistant and I implemented exactly the same question mark trick just the other day. The overall pipeline is quite similar to my previous setup, but I found the STT -> LLM -> TTS pipeline just infuriatingly slow. TTS and STT with whisper/piper worked fine and reasonably fast for me locally, but the real bottleneck was always the fact that they're not running concurrently with the LLM call. I ended up forking an open source openai realtime API ESP32 plugin and patching it to my liking. It's a bit more expensive in terms of API cost but I only use it sparingly and it's so much nicer to use now. | ||
| ▲ | nagen an hour ago | parent [-] | |
[flagged] | ||