> LLM inference enjoys huge economies of scale.

No, it's exactly the opposite.

The big money is in small(ish) but finely tuned for specific tasks models.

Whoever invents an app store for LoRA adapters will win this AI race.