This still blows my mind.

If each human brain consumes ~20W then 10 GW is like 500 M people, that sounds like a lot of thinking. Maybe LLMs are moving in the complete opposite direction and at some point something else will appear that vaporizes this inefficiency making all of this worthless.

I don’t know, just looking at insects like flies and all the information they manage to process with what I assume is a ridiculous amount of energy suggests to me there must be a more efficient way to ‘think’, lol.

▲

sindriava 4 days ago | parent [-]

We know for a fact that current LLMs are massively inefficient, this is not a new thing. But every optimization you make will allow you to run more inference with this hardware, there's not a reason for it to make it meaningless any more than more efficient cars didn't obsolete roads.

	▲	dragonwriter 4 days ago \| parent [-]
		> But every optimization you make will allow you to run more inference with this hardware Unless the optimization relies in part on a different hardware architecture, and is no more efficient than current techniques on existing hardware. > there's not a reason for it to make it meaningless any more than more efficient cars didn't obsolete roads Rail cars are pretty darned efficient, but they don’t really work on roads made for the other kind.