Remix.run Logo
KeplerBoy 7 months ago

Aren't those 400 GB/s a figure which only apply when the GPU with its much wider interface is accessing the memory?

bobmcnamara 7 months ago | parent | next [-]

That figure is at the memory controller.

It applies as a maximum speed limit all the time, but it's unlikely that a CPU would cause the memory controller to reach it. Why it's important is that it causes increased latency whenever other bus controllers are competing for bandwidth, but I don't think Apple has documented their internal bus architecture or performance counters necessary to see how.

doctorpangloss 7 months ago | parent | prev [-]

Another POV is that maybe the max memory bandwidth figure is too vague to guide people optimizing libraries. It would be nice if Apple Silicon was as fast as "400GB/s" sounds. Grounded closer to reality, the parts are 65W.

KeplerBoy 7 months ago | parent [-]

But those 65 Watts contain State of the Art Flops/Watt.