| ▲ | CamperBob2 12 hours ago | |
You could run the full, unquantized model at high speed with 8 RTX 6000 Blackwell boards. I don't see a way to put together a decent system of that scale for less than $100K, given RAM and SSD prices. A system with 4x H200s would cost more like $200K. | ||
| ▲ | ttul 5 hours ago | parent [-] | |
That would be quite the space heater, too! | ||