| ▲ | acc_297 2 days ago |
| This is a common agreement to have with industrial power users. I know in Quebec during the coldest days in winter industrial users are required to scale back. I would hope there aren't too many large utility jurisdictions which would curtail citizen consumers in favour of industrial users in the event of a demand surge. On a related note. It's worrying to me how quickly we've accepted that we're going to boost electricity consumption massively prior to achieving anything close to the carbon intensity reduction targets which would mitigate the worst of climate change effects. It's all driven by a market force which cannot be effectively regulated on a global scale for multinational tech firms who can shop around for the next data centre location with near total freedom. And with advances in over the top fibre networks etc... a tonne of AI demand can be met by a compute cluster on the other side of the world (especially during model training) so the externalities related to the computing infrastructure can theoretically be completely dumped somewhere far away from the paying customer. |
|
| ▲ | everdrive 2 days ago | parent | next [-] |
| It's extremely important to our future that people can vomit out fake movie trailers, and that CEOs can hire fewer people. This is just a cost we need to bear. For sure, any problems introduced by _this_ complex technology will just be solved by future and even-more-complex technologies. |
|
| ▲ | quirk 2 days ago | parent | prev | next [-] |
| https://lomborg.com/ |
|
| ▲ | jeffbee 2 days ago | parent | prev [-] |
| But electricity consumption is a minority of energy consumption. It was always true that decarbonization was going to massively increase the use of electricity. |
| |
| ▲ | acc_297 2 days ago | parent | next [-] | | Yes but the task becomes that much harder - we are scaling up natural gas generation not to phase out coal but simply to meet demand that wouldn't exist without the fierce competition to build the biggest LLM. Any feasible plan made 5 years ago which may have worked to transition a large industry from fuel burning energy sources to electricity generation (renewable or otherwise) is made 10x harder by the introduction of this rapid rollout in datacentre capacity. | | |
| ▲ | jeffbee 2 days ago | parent [-] | | I'm not sure if that's true of not. As the article indicates, training for AI is naturally demand responsive. Training can move on the clock, and it can move around the world to minimize carbon footprint. See the PDF I just love to share: "Revamped Happy CO2e Paper" https://arxiv.org/pdf/2204.05149 | | |
| ▲ | acc_297 2 days ago | parent [-] | | Agree on training. But that google paper was written when the only image model available for broad public consumption was dall-e 2 and video models were more than a year away. It gets a mention in a more recent 2024 paper [1] which goes into detail about how inference rather than training creates the difficult to manage energy load which grids struggle to meet. If consumer interests and demands drive the trend in what companies offer in terms of inference capability then it's fair to worry that the impact on sustainability goals will be an afterthought. [1] https://dl.acm.org/doi/pdf/10.1145/3630106.3658542 | | |
| ▲ | jeffbee 2 days ago | parent [-] | | The second author of that paper is the person who got turfed out of Google for refusing to use actual energy consumption and insisting on using their flagrantly wrong estimate of inference energy costs. E.g. the rebuttal by Dean https://x.com/JeffDean/status/1843493504347189746 | | |
| ▲ | acc_297 2 days ago | parent [-] | | The number was correct to a reasonable degree under the assumptions stated by the author in the paper that tweet references since they obtained estimates from consumer grade hardware and the carbon intensity associated with average kilowatt produced in the United States not a hyperscale datacentre run using "ML best practices" although this distinction is left out of various lay media citations. The number also did not pertain to inference it was associated with training a particular model from pre-2019. | | |
| ▲ | jeffbee a day ago | parent [-] | | I'm sure you see the problem with assuming a very inefficient and poorly-utilized system but at the same time assuming Google scale, and multiplying those factors together. |
|
|
|
|
| |
| ▲ | schiffern 2 days ago | parent | prev [-] | | >But electricity consumption is a minority of energy consumption.
Everything is a minority of energy consumption.https://commons.wikimedia.org/wiki/File:US_energy_consumptio... If your standard is "I won't do anything unless it's the majority of energy consumption," you're really just saying don't do anything period. >It was always true that decarbonization was going to massively increase the use of electricity.
That was the plan (and it could have worked too), but what actually happened is the new decarbonized energy is supplementing fossil fuel instead of replacing it. |
|