My one big problem with OpenRouter is that, as far as I can tell, they don't provide any indication of how many companies are using each model.

For all I know there are a couple of enormous whales on there who, should they decide to switch from one model to another, will instantly impact those overall ratings.

I'd love to have a bit more transparency about volume so I can tell if that's what is happening or not.

▲

minimaxir 8 hours ago | parent [-]

Granted, due to OpenRouter's 5.5% surcharge, any enormous whales have a strong financial incentive to use the provider's API directly.

A "weekly active API Keys" faceted by models/app would be a useful data point to measure real-world popularity though.

▲

eli 7 hours ago | parent [-]

They kinda have that already, no? https://openrouter.ai/apps?url=https%3A%2F%2Faider.chat%2F

▲

minimaxir 7 hours ago | parent [-]

Aggregating by tokens causes the problem simonw mentions in that one poweruser can skew the chart too much.

	▲	simonw 6 hours ago \| parent [-]
		Right, that chart shows App usage based on the user-agent header but doesn't tell you if there is a single individual user of an app that skews the results.