I've been using tools in the OpenAI SDK with voice for well over a year now.

Just super difficult.

See more here:

https://github.com/sibblegp/ODAI/blob/main/routers/app_voice...