Remix.run Logo
grosswait 3 hours ago

So if this all streamed from the internal NVME would you expect better performance?

Argonautlabs 3 hours ago | parent [-]

Just internal 2Tb Macbook M5 Max drive it came in at roughly half the four-drive speed

(0.535 vs 1.038 tok/s at 128 tokens), since one fast drive still has to serve all 16 reads per layer while four drives split the load

https://raw.githubusercontent.com/argonautlabsai/deltafin/ma...