I think the human brain uses something on the order of 10-20W so 13.5W seems like there's probably some room to improve on a 4b model!

▲

dinfinity 13 minutes ago | parent | next [-]

Statements like these often overlook that a human brain is pretty slow for a lot of tasks. It's hard to make direct comparisons, but for language (related cognitive work) we're at maybe a few tokens per second.

I wonder how even a team of humans (a meat mixture of experts) would perform on the AI benchmarks, measured in energy use per intelligence index/benchmark point.

	▲	egberts1 4 minutes ago \| parent [-]
		[delayed]

▲

delichon an hour ago | parent | prev [-]

423. Could y'all please start prefixing comments with the number of joules you consumed in generating it, so that I can decide if it's worth reading?

	▲	Terr_ an hour ago \| parent [-]
		Flashbacks to dial-up internet era, where any website would, parenthetically, indicate how big a linked file was with an estimated download time.