Impressive doesn't mean sustainable.

We're also seeing behemoths like Google and Meta both fail to keep up with OpenAI and Anthropic. Microsoft has given up on SOTA training. Loads of once promising LLM training companies are no longer relevant at the SOTA stage such as Cohere, Mistral.

I've said this countless times but SOTA LLM market looks like a classic monopoly/duopoly market over time. Each generation requires magnitudes more resources to train and you can only compete if you've made enough money on your previous generation.