Remix.run Logo
▲ user43928 5 hours ago

It seems particularly poor compared to larger deployments of other models like Kimi K3.1 Pro.

I've heard numbers between 10k-38k tokens per second per GB300 GPU.

▲lossolo 15 minutes ago | parent [-]

GB300 is a full rack of 72 GPUs and costs ~10x more than two DGXs in the article.