Remix.run Logo
▲ w4der 18 minutes ago

> keeping that illusion consistent and performant requires deep cache hierarchies and coherence protocols that cost area and power, and scale poorly.

Cache hierarchies also exist because memory latency and capacity tend to be inversely proportional to each other, and directly proportional to cost. The underlying process and physics of chip design works against you on this front.

I'd love to have 1 GB of L1 cache, but that is simply not viable because your cache would be as big as your core, way more expensive, and by the sheer size, it would become a NUMA cache, which defeats the point of a cache and the "illusion" of UMA.