... and tomorrow, and the next day.

It never ends. There's no moat. One day your at-home GPU will unwind an entire hyperscaler's worth of expertise.

Does the capital outlay get them anything at all apart from a temporary lead?

While you couldn't download a car, your product use might train a low-cost competitor.