Remix.run Logo
andersmurphy 2 hours ago

Except all those GPUs running inference need to be replaced every 2 years.

phyrex 2 hours ago | parent [-]

Why?

xyzsparetimexyz an hour ago | parent [-]

They wear down being run at 100% all the time. Support slowly drops off, the architecture and even the rack format become deprecated.

well_ackshually an hour ago | parent | next [-]

GPUs do not wear down from being ran at 100%, unless they're pushed past their voltage limits, or gravely overheating.

You can buy a GPU that's been used to mine bitcoin for 5 years with zero downtime, and as long as it's been properly taken care of (or better, undervolted), that GPU functions the exact same as a 5 year old GPU in your PC. Probably even better.

GPUs are rated to do 100%, all the time. That's the point. Otherwise it'd be 115%.

andersmurphy an hour ago | parent | prev [-]

Yeah what's crazy is most of these companies are making accounting choices that obscure the true cost. By extending the stated useful life of their equipment, in some cases from 3 years to 6. Perfectly legal. And it has the effect of suppressing depreciation expenses and inflating reported earnings.