Remix.run Logo
geekone 9 days ago

>rig for local inference for a home agent (powered by four RTX PRO 6000 Blackwell Max-Qs)

can you elaborate at all on what sort of rig you went with, beyond the big $$ GPUs?

elliotbnvl 8 days ago | parent [-]

It's a home desktop form-factor with 8x48gb DDR5 6800, 9985WX, a whole lotta fans and a 1600W PSU. Max-Qs are the only card you can fit four of into this rig without PCIe extenders or cooking themselves, unless you go water cooled (which I didn't).