| ▲ | tidbeck 2 hours ago | |
”Serve the model on either two Mac Studios, with M5 Ultra and 512GB of unified memory; or four Mac Studios with 256GB of unified memory, for a total of 1TB of unified memory, enough to hold a NVFP4 quantized version of Muse Spark Open” Can not find any info on inference speed. | ||
| ▲ | sourcecodeplz 2 hours ago | parent [-] | |
its around 20tps | ||