My first question was: "Is this whitewashing LLM energy usage?"

And yes, that seems to be the undercurrent here. Complete with linking to themselves to validate the data they used to make their estimates.

Either these companies need to build these massive data centers that consume massive amounts of electricity OR these LLMs don't use a lot of electricity.

You don't get both. If LLMs don't require a lot of electricity, then why are we building so much more capacity? If all of that capacity is required, then what is the real cost of sending a query to these LLMs?

▲

MerrimanInd 3 hours ago | parent | next [-]

Hannah Ritchie is a quite well reputed writer and data scientist squarely in the climate field. She's written two books on climate and I found the one I read (Not The End of the World) was quite good and data-driven.

https://hannahritchie.com/

You're going to have to make a stronger case that this data is biased towards LLM than that.

▲

IanCal 3 hours ago | parent | prev | next [-]

I'm not sure I understand where the issue is here - something can use a small amount of energy per use but a large amount in aggregate because of lots of use.

▲

burnished 3 hours ago | parent | prev | next [-]

What about it is whitewashing? This seems like it would be a great resource if you wanted to contextualize the argument you're gesturing at.

▲

raincole 3 hours ago | parent | prev | next [-]

War is Peace,

Freedom is Slavery,

Facts are Whitewashing.

▲

javascriptfan69 3 hours ago | parent | prev | next [-]

Much like when people discuss whether these companies are profitable: training costs don't count.

▲

AgentME 3 hours ago | parent | prev | next [-]

LLMs don't use a lot of electricity per user. Why should the fact that the energy usage happens in data centers instead of each user's house be an important moral factor?

▲

jeffbee 3 hours ago | parent | prev | next [-]

You have set up a false conflict. The data centers are "huge" and they also consume about the same power as 1 airplane. These things are both true.

It is also not really true that they are huge, it is a misconception driven by biased reporting about facilities that really aren't very remarkable compared to material distribution warehouses, beverage bottling plants, and suchlike.

▲

quotemstr 3 hours ago | parent | prev | next [-]

> You don't get both. If LLMs don't require a lot of electricity, then why are we building so much more capacity?

A small number times a large number is often a large number. Have you heard of the concept called "per capita"? In any case, electricity is going towards data centers in proportion to the degree to which these data centers do useful work. AI companies buy the electricity fairly on an open market, sometimes even subsidizing this market by funding new generating capacity.

If all these people and companies are making electricity allocation decisions that make sense to them with their own money, who are you to stop in and say that their voluntary transactions are incorrect? Who died and made you the king?

▲

PowerElectronix 3 hours ago | parent | next [-]

Useful work is debatable here, a lot of people just talk to the thing or use it instead of searching the internet.

The owners surely think, or at least want us to think that it is very useful indeed, otherwise we'd see no point in burning through piles of investors cash to buy overpriced ram, storage, gpus, cpus, nics, secure the power to run it and then subsidise the users to use it.

I do think that transaction is wrong and it's going to bite them in the ass in the long term, but I don't have the money to outbid them for the power. I do get to see them crash and burn when the investors get impatient.

▲

spencerflem 3 hours ago | parent | prev [-]

It’s new capacity!

They’re not even saying they shouldn’t do it or that they’re not useful or not worth it but you Cannot logically say both “these things do not use a lot of power” and “we need to build more power plants to handle these things”

▲

burnished 3 hours ago | parent | next [-]

Yeah you can, though to be fair its referred to as jevons paradox because it is counterintuitive.

	▲	spencerflem 3 hours ago \| parent [-]
		I’m not saying it’s inefficient. I’m saying cloud computing uses a lot of power.

▲

jeffbee 3 hours ago | parent | prev [-]

It isn't all new capacity. The popular discourse hardly ever mentions it but AI is a small fraction of why we need new datacenters and the bulk of the demand is driven by general IT needs, particularly consolidation of small, grossly wasteful corporate data racks into vastly more efficient cloud services.

Edited to answer: The question has also been addressed by the same author as the article: USA spent a quarter century not building generators and that negligence has finally caught up to us, despite objectively heroic efficiency efforts on the part of the IT sector.

https://hannahritchie.substack.com/p/usa-electricity-growth

▲

spencerflem 3 hours ago | parent | next [-]

If so, why do they need to build new power plants for it?

▲

pseudosaid 3 hours ago | parent | prev [-]

[flagged]

	▲	jeffbee 3 hours ago \| parent [-]
		I am a cloud capacity planner and you're just another dog on the internet, "but do go off" as they say online.

▲

oulipo2 3 hours ago | parent | prev [-]

Indeed, looking at a "single median query" totally disregard the fact that:

- first, those queries are mostly useless and we could totally do without them, so it's still a net pollution

- they are being integrated everywhere, so soon enough, just browsing the web for a few hours is going to general 100k+ such equivalent "small queries" (in the background, by the processes analyzing what the user is doing, or summarizing the page, etc). At that time, the added pollution is no longer negligible. And most of this will be done just to sell more ads

	▲	empath75 3 hours ago \| parent [-]
		LLM calls are getting cheaper every day.