A lot of companies are starting to run towards open models on walled off infra. There might be a moat to be had in really good infra-as-a-service for hosting models, but there’s zero moat to be had in the models themselves. Which is a problem for those trying to convince people a proprietary model company should be worth trillions.

I am interested in running my own infra but the cost doesn’t seem worth it? Have you setup something local that’s viable?

That’s an advantage, not a moat