> the GPUs are consumables on a timeline of ~3-5 years

When newer GPUs with clearly better perf/$ are released at a yearly cadence, then older GPUs might indeed become _obsolete_ at this pace, meaning that it makes more economic sense to swap them out because datacenter occupancy is extremely limited. Many of these GPUs might themselves still be functional.

They burn out in the life of a dc.