| ▲ | John23832 35 minutes ago | |
You’re not going to get the same token throughout with the pro 6000 over pcie. You’re paying for speed and bandwidth. | ||
| ▲ | kgeist 24 minutes ago | parent [-] | |
The setup in the article reports 600 tok/sec aggregate decode for GLM 5.3. I get the same throughput on 4x RTX 6000 Pro's connected vi PCIe for GLM 5.3 Flash, which is just 4 points below GLM 5.3 on Artificial Analysis. I'm just saying the setup in the article looks overpriced for what it can actually do | ||