What "second- and third-order effects" do you suppose will collapse the demand for RAM? The people complaining most loudly about RAM costs are the people who want to run local models; if that becomes popular it will supercharge RAM demand, because locally-hosted models can't parallelize runs from many users the way cloud-hosted ones can. I don't see any slackening in RAM demand at any point in the foreseeable future, even if the big AI companies all go bust.

▲

kristopolous 2 hours ago | parent | next [-]

This is all hypothetical and debating hypotheticals isn't productive so let's roll back to markets.

Let's say ram used to cost $100 and now that same unit costs $1000. You paid say $500x1,000 for that unit during the price increase or some price where you can currently flip for profit.

You have a very expensive data center and you're in debt financed on the premise that you have these special computers.

Now a new technique comes out and it turns out you only need 1 memory unit for something that used to require 8 or 4 or some meaningful multiplier.

This stuff happens all the time. It's why we don't use BMP files on websites or serve giant MOV files on YouTube. It's why postgres queries are faster now than they were 10 and 20 years ago.

You rent out your machines. You need to service your debt.. Demand may 8x overnight to accommodate but you have a monthly bill to pay and that's unlikely. It's likely going to drop.

Think about it. Your customers are paying maybe $10,000 a month and serving their customers. Now they can drop that to $1,250.

On market if you were to sell some of that ram you have 100% profit right now but not for long.

Jevons paradox assumes unlimited capitalization, zero debt servicing, infinite time horizons...

We live in the real world so what do you do?

Historically the answer has been "sell that shit"

There's an aphorism for this "stairs on the way up elevator on the way down"

If we had a healthy market with sane prices where you can't flip the thing you bought for 100% profit the answer would be "create more value."

	▲	charcircuit 2 hours ago \| parent [-]
		>Your customers are paying maybe $10,000 a month and serving their customers. Now they can drop that to $1,250. Or they could stay at $10,000 per month since they are willing to pay that much already.m, so they just use AI more and in more places.

▲

lxgr 2 hours ago | parent | prev [-]

> locally-hosted models can't parallelize runs from many users the way cloud-hosted ones can

Why not? Unlike many other workloads, LLM inference actually seems pretty suitable for decentralization (effectively stateless means no availability concerns; bandwidth and latency are relatively forgiving too).

	▲	Analemma_ 2 hours ago \| parent [-]
		I think locally-hosted models at the org level will definitely be somewhat popular, but you seem to be talking about decentralizing for people's personal, non-business use, and I just don't think that's going to happen to any real degree. People who say they want local runs really mean it: they want local runs on hardware in their room, not on some decentralized system which, if it existed, would almost certainly just be a worse, less-reliable version of cloud hosting. I'm not saying nobody would use it, but it sounds a lot like things like IPFS, which have also completely failed to displace either cloud storage or buying a bunch of disks for your own private use.