Remix.run Logo
▲ AI compute is the new oil–and needs a new market(economist.com)
25 points by ijidak 3 hours ago | 16 comments
▲vannevar 2 hours ago | parent | next [-]

AI compute is not the new oil. Demand for oil is very inelastic: it's very difficult to increase the thermodynamic efficiency of the physical processes that convert oil into energy. AI compute efficiency, on the other hand, is improving exponentially. AI will end up being just slightly more expensive than the raw electricity required to produce it.

Data center demand right now has much more to do with private credit's demand for new deals, since the binge they went on around the pandemic led to the accumulation of a lot of bad debt and depreciating assets. Data centers are a tool for extracting money from insurance trusts and pension funds to prop up private credit and create debt-driven artificial "revenue" for the hyperscalers and Nvidia.

▲simoncion an hour ago | parent | next [-]

> AI will end up being just slightly more expensive than the raw electricity required to produce it.

AFAICT, this hasn't happened for any "cloud" compute company that has been in business for -say- at least five years. Unless your prediction is that roughly no one will use "cloud" "AI", I'm rating this prediction as "totally bogus". And if that is your prediction, then what you're saying is

  Assuming that you're not doing anything that needs exotic system administrators, nearly all of the cost of computing when you own your own hardware is the power for that hardware.
which... unless you're buying used hardware, I don't think that's true, either. Hetzner quotes a max of 167.23 EUR/month for a full rack and what I think is 2400W of power, and lists the rate for Finnish power as 0.22 EUR per kWh. [0] If we assume that Hetzner's spending cap doesn't apply and we are forced to pay the full quoted rate for power in Finland, I think that works out to a bit under 4.6K EUR per year:

  240V * 10A = 2.4kW
  2.4kW * 24H * 30 * 12 = 20,736 kWh
  20,736kWh * 0.22 EUR/kWh  = 4562 EUR/year
The last time I got quotes for most of a rack of server hardware was like a decade ago, and that pretty-bog-standard server hardware ran around 200K USD. If we assume a ten-year expected life [1], that hardware cost about 17K EUR per year. Assuming I haven't fucked up my math, [2][3] the cost of the hardware here is more than three times the cost of power.

Note that I'm using roughly decade-old hardware prices and allegedly-current electricity prices. If we used hardware prices from two years ago -or worse, from today- the hardware would cost far more per year.

[0] <https://www.hetzner.com/colocation/>

[1] ...which I think is between two and three times longer than is standard to expect in the business world...

[2] ...it's very likely that I have! Corrections are definitely welcome.

[3] ...it's also possible that USians get gouged for server hardware and that it's like a quarter of the cost if you buy it in Finland. I expect that there's definitely a price difference, but I doubt that it's very large.

▲vatsachak 2 hours ago | parent | prev | next [-]

Yeah AI is electricity, not oil. It's boring but it's already true.

I'm building a side business and decided to go with open router because that's what AI is going to look like in the future. Just intelligence/$ everything else kind of not important.

Unless, they solve the issue of model output diversity and Claude becomes very different from ChatGPT

▲vinyl7 44 minutes ago | parent | prev [-]

History has proven that businesses will relentlessly and needlessly raise prices to increase revenue quarter over quarter.

▲raziel2701 43 minutes ago | parent | prev | next [-]

I remember in the 2010s when people were saying Big Data is the new oil

▲kylehotchkiss 39 minutes ago | parent [-]

Remember when people thought crypto and NFTs were the new oil... lol. LLMs will have staying power, there's just a day where this seems like it's all going to run on our laptops. OpenAI's fear of that and tanking the RAM market was just a temporary setback.

▲jordemort 20 minutes ago | parent | prev | next [-]

the new oil as in we’re going to make a bunch of products that are needlessly packaged with derivatives of it, leaving behind a toxic mess that will take generations to clean up?

▲Avicebron 3 hours ago | parent | prev | next [-]

AI has to take us where We want to go before its compute can be considered on par with oil.

▲userbinator an hour ago | parent [-]

I think that's starting to happen. There's a new vibecoded project shown off here almost every day. YouTube has gotten a lot more entertainment rising above the slop. People are beginning to realise what AI can do for them.

▲byzantinegene 33 minutes ago | parent | next [-]

i would argue that youtube has gotten alot worse this year, and every vibecoded project shown off here has been pretty soulless and pointless.

▲creata 25 minutes ago | parent [-]

It's hard to say that all the (to varying degrees) vibecoded security vulnerabilities posted to the frontpage are pointless.

▲creata an hour ago | parent | prev [-]

> There's a new vibecoded project shown off here almost every day.

Every other post on the News.YC frontpage has been about AI for the past few years. That means very little.

> YouTube has gotten a lot more entertainment rising above the slop.

Examples would be great. I'm looking on YouTube's "hot" playlists and haven't yet seen anything marked AI, although that of course doesn't rule out the use of AI.

▲j16sdiz 2 hours ago | parent | prev | next [-]

infrastructure project big enough to affect qol in neighborhood: checked

corruption: checked

regulatory capture: in progress

Ya, the new oil.

▲vdfs 2 hours ago | parent | prev | next [-]

"We need a market for the largest capex in history"

▲teeray 2 hours ago | parent [-]

"Why will nobody buy my Tulips?"

▲BatchJob 3 hours ago | parent | prev [-]

AI news is the new IDGAF and needs a new website.