| ▲ | rrhjm53270 4 hours ago | |
Would it possible to stack up to 16x32GB VRAM, and test the performance of a MOE model such as Deepseek-v4-flash? | ||
| ▲ | eso_logic 4 hours ago | parent [-] | |
16 GPUs would require one or more 220V breaker panels, more akin to an EV charger than a computer. You would also quickly run out of PCIe lanes. My goal with this benchmarking is to think about what is the most cost effective way to fill 4U. | ||