| ▲ | epistasis an hour ago | |
> Does it take into account the entire lifecycle, building the data centre My entire point is that 99% of the dollar cost of running these models goes to things other than the GPU power. The capex cost to building cost to GPU cost to storage/networking/chasses/wiring plus the other operation costs dwarf the electricity. Even the other electricity costs, lets say double it for all the supporting compute, plus another 25% for a 1.25 PUE, and you're at 2.5% of all-in cost of running these models is from electricity. The non-electricity costs are massive and the constraints on fabs, etc. will drive the amount of the AI build far more than energy availability. | ||