Remix.run Logo
▲ to11mtm an hour ago

> which is why the crunch has lasted so long,

It's been like a year-ish...

And maybe 2027 is a truly optimistic relief on some level,

> a second wave comes in 2028–29, and a lot of that new capacity is aimed at HBM and server memory, so consumer DDR5 and GDDR will likely ease last.

'Consumer DDR5' has a pretty big set of knock-on effects though.

Unless you are working at a 'tech' company, the norm is that even developer machines will be constrained on memory usage for a given workload[0][1]. IOW companies trying to keep procurement in check wind up looking at procurement cost vs lost productivity.

[0] - Modern infosec and corporate software, at least where I'm at, seems to be vaguely more efficient than electron apps, IOW I can reboot, open teams and my IDE, after 4GBish of my IDE and 1GB of a fresh Teams instance I'm already around 16 of 32GB.

[1] - I had to fight hard to get 32GB as a developer baseline at my org. They wanted 16GB. Ironically the JVM based devs get 64GB but still have slowdown issues on biuld...

▲josephg 21 minutes ago | parent [-]

> Unless you are working at a 'tech' company, the norm is that even developer machines will be constrained on memory usage for a given workload

Honestly I think most of us are just spoiled kids crying when our expensive toys are being taken away. If memory cost 10x more to manufacture than it does now, we’d just have 10x less ram in our computers and our software would be written to deal with that. We’ve done it before. My first computer had 4mb of ram and it ran windows 3.1 just fine. We still had working compilers. If ram were 10x cheaper before the supply shock, I think we’d be crying that companies won’t buy us 320gb ram in our laptops. The java and rust compilers would somehow be even less ram efficient. Firefox and chrome would still happily use it all to run adware across the same 50 tabs I want to keep open.

Not everything. Theres good reason for LLMs to need that much ram. And scientific computing. And .. well I can’t think of much else.

The supply crisis is annoying. But I’m also a little glad there’s a reason to push back on fat, lazy software.