I manage our company's model spend and build tools around it.

The good thing about the developer experience is that it is dead simple to create keys that are time-bound, model restricted, and have budgets against them in an easy, programmatic way (also in bulk). Costs are guaranteed to be on par or lower than any model provider, so it's an easy sell to the finance department.

To look at it from the other side, Gemini is the absolute worse when it comes to key management. The labyrinth of actions that one has to navigate to generate budgeted keys for a team is not worth it and I still haven't figured out how to manage the keys at a granularity I need.

OpenAI and Anthropic both have what I would consider to be middling DevEx. Most things work, but only on their platform, and there are some weirdnesses, like the fact that anthropic disabled its admin API key creation, so you can't programmatically create keys against a budget.

I work on DevEx for OpenAI's API - I'd love to hear more about what we could be improving here!