Remix.run Logo
▲ fwlr 16 hours ago

“Space/time tradeoffs” I guess would be the name of it. Memory latency and bandwidth trails op/s of the CPU - operations beat fetches by ~2 orders of magnitude; memory complicates both SIMD and parallelism across cores which is another ~1 order of magnitude each. The back of the envelope suggests we left a 25,000x speedup factor on the table because our systems and tools and intuitions have converged on load-op-store-load-op-store, instead of load-op-op-op-[…]-op-op-store.