Remix.run Logo
▲ tidbeck 2 hours ago

”Serve the model on either two Mac Studios, with M5 Ultra and 512GB of unified memory; or four Mac Studios with 256GB of unified memory, for a total of 1TB of unified memory, enough to hold a NVFP4 quantized version of Muse Spark Open”

Can not find any info on inference speed.

▲sourcecodeplz 2 hours ago | parent [-]

its around 20tps