| ▲ | darknoon 4 hours ago | |
really weird graph where they're comparing to 3x H100 PCI-E which is a config I don't think anyone is using. they're trying to compare at iso-power? I just want to see their box vs a box of 8 h100s b/c that's what people would buy instead, and they can divide tokens and watts if that's the pitch. | ||
| ▲ | ac29 19 minutes ago | parent | next [-] | |
> they're trying to compare at iso-power? Yeah they are defining a "rack" as 15kW, though 3x H100 PCIe is only a bit over 1kW. So they are assuming GPUs are <10% of rack power usage which sounds suspiciously low. | ||
| ▲ | minimaltom 3 hours ago | parent | prev [-] | |
Whats a more realistic config? | ||