| ▲ | rohansood15 3 days ago | |
Given the new architecture, speeds are harder to estimate. Max would be ~40 tok/s. | ||
| ▲ | lxkarthi 2 days ago | parent [-] | |
I can run Deepseek flash 0731 version (ds4, esl3) on single DGX spark. getting around ~20 tok/s. It's great. Quantized version of this model would probably run on the DGX spark. I am excited to wait for quantized models that fits in single DGX spark. | ||