> There's a second bus factor: What happens when that 8xH100 starts to get flakey?

These come in a non-flakey variant?

It's called a warranty.

And the other argument: every company I've ever know to do AWS has an AWS sysadmin (sorry "devops"), same for Azure. Even for small deployments. And departments want their own person/team.