Speed highly correlates with power efficiency. I believe my hardware maxes out somewhere around 150W. 15 seconds of that isn't much at all.

> Also, why are people moving mountains to make huge, power obliterating datacenters if actually "its fine, its not that much"?

I presume that's mostly training, not inference. But in general anything that serves millions of requests in a small footprint is going to look pretty big.