Remix.run Logo
▲ fragilerock 3 hours ago

Interesting read! I have my own local voice assistant and I implemented exactly the same question mark trick just the other day.

The overall pipeline is quite similar to my previous setup, but I found the STT -> LLM -> TTS pipeline just infuriatingly slow. TTS and STT with whisper/piper worked fine and reasonably fast for me locally, but the real bottleneck was always the fact that they're not running concurrently with the LLM call. I ended up forking an open source openai realtime API ESP32 plugin and patching it to my liking. It's a bit more expensive in terms of API cost but I only use it sparingly and it's so much nicer to use now.

▲nagen an hour ago | parent [-]

[flagged]