Remix.run Logo
bluechair 4 hours ago

I missed the explanation for how the SSDs are connected.

Maybe a dumb question.

Argonautlabs 4 hours ago | parent [-]

SSDs are connected via Thunderbolt 5 enclosures. I have one Gen4 and three Gen5 ssds inside enclosures. You can see specs here

https://github.com/argonautlabsai/deltafin/tree/main/k3-publ...

grosswait 3 hours ago | parent | next [-]

So if this all streamed from the internal NVME would you expect better performance?

Argonautlabs 3 hours ago | parent [-]

Just internal 2Tb Macbook M5 Max drive it came in at roughly half the four-drive speed

(0.535 vs 1.038 tok/s at 128 tokens), since one fast drive still has to serve all 16 reads per layer while four drives split the load

https://raw.githubusercontent.com/argonautlabsai/deltafin/ma...

_zoltan_ 2 hours ago | parent | prev [-]

What exact enclosure are you using?

Argonautlabs 2 hours ago | parent [-]

OWC Express 1M2 (Thunderbolt 5, single M.2 NVMe) — three of them, two on the Mac's own ports and one behind an OWC Thunderbolt 5 hub since the machine has three ports.

Each enclosure tops out at about 7.1 GB/s on whole-file reads regardless of the drive inside (a 2 TB SN8100 measures the same as the 1 TB);

the drive behind the hub reads 5.7 GB/s and falls with queue depth.

Details in the README's hardware section