Presumably when the power consumption costs more than the cost of replacement.

It’s not so much that these GPUs stop working after 3 years, but that newer GPUs can handle more requests with less power for the same purchase price. So the useful value of the GPU degrades until eventually it’s cheaper to replace than to keep running.