With respect to consumption, it’s pretty efficient vs older traditional servers, though I know workloads like that aren’t completely fungible. Nonetheless it bears keeping in mind that a single GB200 NVL72 rack provides 1.4 ExaFLOPS of AI compute (at FP4 precision, ideal circumstances, but this is envelope math all around). So it’s power efficient, for what it is.

▲

HolyLampshade 2 hours ago | parent [-]

Oh, I have no doubt it is functionally efficient. I'm just amazed given the system deployments I've been party to, and the tiny amount of per rack energy usage comparatively speaking given the functionality of those systems.

Like, what in the good god damn are we using all this energy for?

	▲	bayarearefugee an hour ago \| parent [-]
		> Like, what in the good god damn are we using all this energy for? Bad AI porn, terrible AI music, AI scams and completely devastating the labor market. And based on the recent Anthropic/Pentagon rift... I guess also creating autonomous kill-bots and doing mass surveillance. Just a bunch of super cool stuff.