> In a compute-constrained world where model demand is growing faster than capacity

I don't buy it.

There have been recent weeks where some of the mid-level models (Hy3, Laguna M.1) are free (true for parts of June and July, see Hy3 in Cyan) . Even then the total token usage appears to be reaching a steady-state.

https://openrouter.ai/rankings#top-models

^ the first graph is tokens per week across all models

I guess we just can only throw ideas at an LLM at a certain rate.

I still have ideas and now I can have an LLM vibe code what I want, but I'm not going to let an agent just run unattended for longer than a few minutes or a few bucks for hobby projects.

So maybe it is a matter of lowering the cost of an LLM so I can let it churn for hours at a cost of pennies... But I suspect demand for tokens is very price-elastic.

These are free due to some different type of reasons like Nvidida sponsoring free tokens or the model companies.

My company checks the models and pays for Opus through AWS.

You still send the WHOLE context of whatever you want to do to a random endpoint on the internet. If you want to write a good email, you give that context your email address, names, the reason for it etc.

Big companies don't randomly use some random api endpoint to do so.

Anthropics quarerly revenue is still growing very fast. I don't think we have seen even the real potenzial of it yet at all.

Not only are still a lot of countries missing which do not even use anthropic or any other frontier model yet but also all the agentic based solutions enterprise companies are currently building on mass (at least in my industry)

Openrouter is not even CLOSE to the majority of tokens. I don't know where this myth came from that they account for even ~5% of total token spend! It's not true!!!!

Stop rejecting what we have been collectively telling you guys! LLM providers are profitable, and have been for awhile!