GPUs completely dominate the cost of a server, so a GPU upgrade typically means new servers.

Agree - newer GPU likely will need faster PCIe speeds too.

Kinda like RAM - almost useless in terms of “upgrade” if one waits a few years. (Seems like DDR4 didn’t last long!)