Remix.run Logo
bayindirh a day ago

Every RAM producer is stopping their consumer grade RAM production to provide ECC-RAM and VRAM now. Micron discontinued and closed down Crucial brand as a whole.

So, getting systems with higher RAM capacity is getting harder (from laptops to smartphones). So, for a couple of years, we need to stop using Electron so much and use what we have efficiently.

Data centers, esp. AI hyperscalers do not care about efficiency for now, because they can suffocate consumer-grade part of the hardware marketplace and get anything and everything they want. When their bubble pops, or the whole capacity ends, they need to learn to be efficient, too.

For reference, a well-optimized cluster runs at ~90% efficiency even though they have thousands of users. AI hyperscalers are not there. Maybe 60% efficient, at most. They waste a lot of resources to keep their momentum.

spockz a day ago | parent [-]

I have a silent hope that because of this change we all will get ECC ram and that consumer CPUs will get proper support for them.

bayindirh a day ago | parent [-]

AMD's RYZEN already supports it. ASUStor's latest generation of NAS devices come with AMD x86_64 processors and ECC RAM as a standard, but ECC RAM in SODIMM format was not cheap, even when the RAM was cheap, either.

spockz 20 hours ago | parent | next [-]

I understood that support for ECC ram also depended on the motherboard but not sure. When selecting Ryzens, I only recall seeing many disclaimers for RAM support. Not sure to the causes though.

wiredpancake 14 hours ago | parent [-]

[dead]

eggsome 15 hours ago | parent | prev [-]

As someone trying to spec out a Ryzen workstation right now I can tell you it's actually harder because Ryzen (unlike EPIC) uses UDIMM ECC, not RDIMM ECC. It's a niche that very few companies wanted to service before AI ram madness. Now the only vendor I can find is v-color:

https://v-color.net/products/ddr5-ecc-oc-u-dimm-server-memor...

But they no longer have 6000mhz stuff in stock (which is ideal for Ryzen due to the 1 to 1 speed match to the memory controller).

It's frustrating :(