What's good about their DevEx?

sarabande 3 hours ago | parent | next [-]

I manage our company's model spend and build tools around it.

The good thing about the developer experience is that it is dead simple to create keys that are time-bound, model restricted, and have budgets against them in an easy, programmatic way (also in bulk). Costs are guaranteed to be on par or lower than any model provider, so it's an easy sell to the finance department.

To look at it from the other side, Gemini is the absolute worse when it comes to key management. The labyrinth of actions that one has to navigate to generate budgeted keys for a team is not worth it and I still haven't figured out how to manage the keys at a granularity I need.

OpenAI and Anthropic both have what I would consider to be middling DevEx. Most things work, but only on their platform, and there are some weirdnesses, like the fact that anthropic disabled its admin API key creation, so you can't programmatically create keys against a budget.

▲

charlierguo an hour ago | parent [-]

I work on DevEx for OpenAI's API - I'd love to hear more about what we could be improving here!

	▲	matznerd an hour ago \| parent [-]
		Not OP, but you can't set a per api key limit in OpenAI Platform, you also can't really easily see spending going on per key, and its also in a far off page separate from the keys, really not easy to see what is going on with spend in real time.

▲

OleksandrC 3 hours ago | parent | prev | next [-]

I am working on my own agent implementation (https://usehax.dev/), and I can praise OpenRouter for being seemingly the only provider endpoint that actually gives proper API for gathering available models and their capabilities (context length, image support, pricing, etc), reports exact routing details and total cost in the response, and provides an endpoint for obtaining current available credits (for "/usage"-like command). So for OpenRouter specifically I could deliver a really good experience out-of-the-box (always fresh models and metadata, exact pricing, etc).

You would think that these things would be standard fare, but they really are not. Other providers need metadata from a separate catalog, don't report pricing, don't really report available credits / usage either.

So yes, OpenRouter does have a good DevEx.

▲

etskinner 3 hours ago | parent | prev | next [-]

Speaking for myself (I'm not the GP comment): The platform 'just works', has great reporting interface to help understand excatly what usage happened when, and integrates well with lots of different harnesses.

▲

mhh__ 2 hours ago | parent | prev | next [-]

It works

▲

jacobgold 3 hours ago | parent | prev [-]

You create an account. Pay money. Get API key. Use APIs.

▲

ApolloFortyNine 3 hours ago | parent [-]

But if you use any decent amount of tokens, it's probably worth saving the 15% by moving to the provider they're proxying.

And if it's not worth it, then are you spending enough where it even effects Openrouter's bottom line?

With enough devs playing with hobby projects I'm not doubting it's profitable, only that $7 billion seems way too high.

▲

asadm 3 hours ago | parent | next [-]

OR I can keep paying 15% markup till next month and then jump to newest / cheapest model with one-liner change instead of being locked to a model/provider.

▲

cute_boi 2 hours ago | parent | next [-]

Which model/provider locks like this, most of them use chatgpt style apis anyway.

	▲	tomnipotent 2 minutes ago \| parent [-]
		That requires that you create accounts and separately manage each provider you want to use. OpenRouter removes that - if a new provider gets added, you can start using them immediately.

▲

akho 2 hours ago | parent | prev [-]

Aren't they all the same api? Are you paying 15 % to change one line, and not, like, three?

▲

Tepix 2 hours ago | parent | prev [-]

15%? Isn't the fee 5.5% with lower fees for enterprise customers?