Remix.run Logo
▲ John23832 35 minutes ago

You’re not going to get the same token throughout with the pro 6000 over pcie. You’re paying for speed and bandwidth.

▲kgeist 24 minutes ago | parent [-]

The setup in the article reports 600 tok/sec aggregate decode for GLM 5.3. I get the same throughput on 4x RTX 6000 Pro's connected vi PCIe for GLM 5.3 Flash, which is just 4 points below GLM 5.3 on Artificial Analysis. I'm just saying the setup in the article looks overpriced for what it can actually do