Remix.run Logo
rhdhfjej 4 days ago

Your brain has a TDP of 15W while frontier LLMs require on the order of megawatts. That's 5-6 orders of magnitude difference, despite our semiconductors having a lithographic feature size that's also orders of magnitude smaller than our biological neurons. You should do some more research.

adrian_b 3 days ago | parent | next [-]

The TDP of a typical human brain is not 15 W, but 25 W, so about the same as for many notebook or mini-PC CPUs, but otherwise your argument stands.

The idle power consumption of a human is around 100 W.

logicchains 3 days ago | parent | prev [-]

>Your brain has a TDP of 15W while frontier LLMs require on the order of megawatts.

You should do some basic maths; the megawatts are used for serving many LLM instances at once. The correct comparison is the cost of just a single LLM instance.

rhdhfjej 3 days ago | parent [-]

Yes, the cost figures published by LLM labs imply a power consumption measured in megawatts for each instance of top performance frontier models. Take the L.