Unfortunately, the AI being locked down and proprietary is the winning strategy for these companies.

My company hosts its own models. Some customers require us to use either US / EU models, while others are fine with us using any model.

As such, we have two GPU clusters, the general AI cluster runs a Chinese model as it's the most accurate and robust. The US/EU required ones have a few percentage points lower on our accuracy metrics and we provide them those that require it for an extra fee.

Why host at all? Because it enables us to get much higher margins than competitors, while reducing costs. Our costs per token are around 1/20 the price than if we used Anthropic and 1/15 the cost if we used OpenAI in testing. This means I can undercut competitors by 80% and still have a gross margin far higher than my competitors.

In reality, these US AI providers are jacking up the prices and trying to implement regulatory capture. I'm actually fairly confident they'll succeed. At some point, I'm expecting the US / EU administration(s) to block foreign based model, at the same time, they'll probably invest in Anthropic and OpenAI.

What Anthropic and OpenAI are doing is using "safety" as a wedge, just like large corporations used "environmentalism" or "food safety" or "workers safety" as a wedge to regulate smaller competitors out of the picture. Then they jack up rates, sue and/or buy anyone who can potentially be a threat. It's the #1 threat to our business model.

Our competitors are giving half of their margin over to these large AI service providers, we keep the vast majority of ours. Eventually the AI service provider will be able to squeeze them even more until the margin just isn't there and either they are purchased or replaced via internal tools at the company they sell to.