“100% guaranteed downtime when you least can afford it and the support tickets are your problem.”

We’ve a hybrid shop, including hosting our own ML infra, and we save a ton from cloud spend with local ML. Easily one million USD over past three years. But it’s not “free”, you are shifting a lot of labor into your plate.

And with that also gain institutional knowledge, skill up your workers and attract talent that wants to work on this stuff.

All boils down to short-term/long-term thinking.