Remix.run Logo
Gigachad 2 hours ago

They are also likely overestimating the useful lifespan of the hardware. They keep extending the number of years on the GPUs to make the accounting look better.

BLKNSLVR 2 hours ago | parent [-]

When are these GPUs going to be available on the second hand market?

devsda 14 minutes ago | parent | next [-]

If the supply side constraints remains the same, I doubt they'll be releasing their GPUs as they could be considered strategic assets. Their current moat is largely hardware right.

In few years open weight models may be good enough for anything but advanced usecases. With right hardware, competition may grab the lower end of market using open models. There's also potential loss of interesting training data from real conversations.

I see more downsides than upsides.

Gigachad 2 hours ago | parent | prev | next [-]

Presumably when the power consumption costs more than the cost of replacement.

It’s not so much that these GPUs stop working after 3 years, but that newer GPUs can handle more requests with less power for the same purchase price. So the useful value of the GPU degrades until eventually it’s cheaper to replace than to keep running.

fragmede 2 hours ago | parent | prev [-]

Standard depreciation is 3-5 years.