Remix.run Logo
▲ Goodliff 36 minutes ago

I work in AI, but this is obviously not sustainable unless renewable energy is used.

But according to AI Multiple:

Globally, only about 22% to 27% of the actual electricity consumed by AI and data center facilities comes directly from renewable energy sources like solar, wind, and hydropower.

They recommend the obvious, "Prioritize inference efficiency over training efficiency" since most power is used for inference now.

They reference research that shows that over 80% of AI compute is now used for inference.

https://aimultiple.com/ai-energy-consumption

▲j45 34 minutes ago | parent | next [-]

There is one more thing to consider - have our phones and software not become more efficient with computational power and battery life?

I don't see that referenced anywhere often enough in the AI datacenter swirling.

It's like saying mobile phones from the 1990's would never become more efficient, nor software, nor chips.

▲scottLobster 25 minutes ago | parent [-]

Most of those efficiency gains came from shrinking transistors, and we've already hit the physical limits of Moore's Law with atomic-scale transistors.

That's not to say there aren't more efficiency gains to be found, but the low-hanging fruit has been thoroughly picked.

▲mw888 26 minutes ago | parent | prev [-]

"Work in AI" is one of those vague claims that could mean you work in a field relevant to the topic at hand, infrastructure, or that you simply use AI a lot at work. If your role was the more relevant one, one'd expect you to claim it specifically.

Your point is so basic it requires no expertise to reason about, however, anyways.