▲ | logicchains 3 days ago | |
>Your brain has a TDP of 15W while frontier LLMs require on the order of megawatts. You should do some basic maths; the megawatts are used for serving many LLM instances at once. The correct comparison is the cost of just a single LLM instance. | ||
▲ | rhdhfjej 3 days ago | parent [-] | |
Yes, the cost figures published by LLM labs imply a power consumption measured in megawatts for each instance of top performance frontier models. Take the L. |