Is batch mode on the roadmap? As the frontier model providers start to think more and more about profitability, and prices/latencies rise as a result, I can see batching becoming more and more necessary for many use cases.

Would love to know we can build against the OpenAI batch API and (soon?) have a path towards being model-agnostic.