I'm working on a tool to do evals for voice agents. The way it works is that you simply post your recordings, tools, instructions, etc and we do a diff to spot if something changes, then we mark a note on the change and run evals.

The main idea is that you don't need to configure anything, simply send us the data and we should figure out evals for you.

If anyone is building with realtime voice send me an email at username at Gmail and I'll try to help you improve your tool for free (In exchange I get to talk to real users)