LLMs are very competitive on power use at inference time.

Sure, frontier LLMs require timeslots on massive server arrays. But they also get things done a lot faster than humans do. The net favors the LLM.