> Your example also counters your point: A lot of people do not care about 4k, and even less do care about 8k or above. We reached a point where most people are completely happy with the quality they get.

And when (not if) we get to the 4k (or 8k) equivalent of LLMs, they'll just be baked into hardware and we'll have near instant responses while running locally.

There is no future where OpenAI, Anthropic, etc survive with their current business model; at some point we will hit a point where training a new model is done only every 5 years or so, and in that scenario we aren't going to be running models of pricey server GPUs with latencies measured in seconds and full responses measured in minutes.

We'll be running locally with sub-millisecond latencies and responses measured in milliseconds. There is no way for any big company to compete with the current business plan of selling inference or subscriptions.