Remix.run Logo
rohansood15 3 days ago

Given the new architecture, speeds are harder to estimate. Max would be ~40 tok/s.

lxkarthi 2 days ago | parent [-]

I can run Deepseek flash 0731 version (ds4, esl3) on single DGX spark. getting around ~20 tok/s. It's great. Quantized version of this model would probably run on the DGX spark. I am excited to wait for quantized models that fits in single DGX spark.