Remix.run Logo
freakynit 3 hours ago

"Over the last six months, weekly volume on OpenRouter has grown from 5 trillion to 25 trillion tokens".

DAMN!!

That's 41+ million tokens every second. That scale is crazy for such a small team of 48-50 people overall.

wahern 14 minutes ago | parent [-]

Assuming that's token cost upstream, and given the multiplication factor in tokens processed per query, that seems like maybe a few thousand requests per second at most? It's impressive but for a 50 person startup team expending millions per month, that seems about on par.

Would it be as impressive if the context were an email provider accepting thousands of message per second, or even one accepting thousands of messages per second and submitting them upstream for spam detection? The token count might even be higher in that case, but rightly or wrongly I think it would get a yawn on HN.

It says more about how far the industry has come these days in terms of scale on the one hand, but also on the other hand the huge blowup in data and processing for nominally simple requests. Nonetheless I'm sure the team is exceptionally skilled and it's certainly a laudable accomplishment.