| ▲ | geekone 9 days ago | |
>rig for local inference for a home agent (powered by four RTX PRO 6000 Blackwell Max-Qs) can you elaborate at all on what sort of rig you went with, beyond the big $$ GPUs? | ||
| ▲ | elliotbnvl 8 days ago | parent [-] | |
It's a home desktop form-factor with 8x48gb DDR5 6800, 9985WX, a whole lotta fans and a 1600W PSU. Max-Qs are the only card you can fit four of into this rig without PCIe extenders or cooking themselves, unless you go water cooled (which I didn't). | ||