That 1tb / 12 channels is a continuous streaming read / write rates? I assume big wide DDR memory, for random "IO", is much slower than compared to HBM.

I feel like at a certain point there are just going to be big SOC packages with 128gb of ram and stacks of cores (each with their own "local" cache) and the 128gb "local" HBM on-package ram will just be the 4th or 5th level cache, and big server boards will have 4 of those and CXL elsewhere for "main" memory.

And things like the VAST stuff also blur lines between high speed local storage and less performant san or bulk commodity storage.

The old memory / storage hierarchies are getting mixed up (again).

Interesting times.