Remix.run Logo
dietr1ch 4 hours ago

> The training cost for a model is constant

Constant until the next release? The battle for the benchmark-winning model is driving cadence up, and this competition probably puts a higher cost on training and evaluation too.

simonw 4 hours ago | parent [-]

Sure. By "constant" there I meant it doesn't change depending on the number of people who use the model.

dietr1ch an hour ago | parent [-]

I got that part, it's just that it overlooks the power consumption of the AI race.

I wish we reach the everything is equally bad phase so we can start enjoying the more constant cost of the entire craze to build your own model with more data than the rest.