| ▲ | botusaurus 2 hours ago | |
ok, your quote was over generalized, you meant "current LLM need..." and not "any conceivable LLM" although the word "energy" does not appear on that page, not sure where you get the galaxy energy consumption from | ||
| ▲ | Joel_Mckay 24 minutes ago | parent [-] | |
In general, "any conceivable LLM" was the metric based on current energy usage trends within the known data-centers peak loads (likely much higher due to municipal NDA.) A straw-man argument on whether it is asymptotic or not is irrelevant with numbers that large. For example, 75% of a our galaxy energy output... now only needing 40% total output... does not correct a core model design problem. LLM are not "AI", and unlikely ever will be due to that cost... but Neuromorphic computing is a more interesting area of study. =3 | ||