Great read. I'd love to know more about how power consumption changes as cards get newer too!

Thanks! Yeah this is a major consideration. I have looked at power consumption throughout runs in the past (https://esologic.com/gpu-server-benchmark/#gpu-box-benchmark) and found that for many of these enterprise class cards, they're happy to slam right into the max TDP. So, for doing actual work, you'll be living up closer to the rated TDP of the cards. Recording power consumption is easy on nvidia and I'll likely add this to future versions of the benchmarking tool.

for some of these gpus you can set a very reduced power limit for modest reduction in performance, tdp is not the full story

[dead]