Also imagine people having their own cheap 2TB rigs at home for their own usage/inference, or a multitude of small providers serving/sharing capacity thanks to cheap available hardware.

But we cant have that, as the big guys are hoarding everything for themselves, so that you have to pay them instead.

>even if there was enough power there’s no use case for this much spend

According to them, demand for tokens already exceeds supply. Coding agents are very popular but burn through millions of tokens per hour.

The reasoning models that have powered breakthroughs in AI for math, coding, etc require substantially more compute than base LLMs.

I’ve been wondering this if you buy up all the memory you can ensure the competition cannot compete with huge investment raising the bar for competition. Of course this all sounds all conspiracy theory. Though without a place to power this or put it makes me wonder this.