If you don't believe AWS follows their ToS, you shouldn't use any cloud provider for CPU/data storage/anything else either. That's not a mainstream position in the industry.

As long as you don't have "realtime" workloads, owning the GPUs quickly becomes the economical option. The main cost problems is in e.g. chat applications where the workload is spikey, and users expect an near-instant response, for which you need to scale the GPUs to the highest spikes of the workload.

You really don't need to be large. $100k can buy you a lot of compute and it's less than hiring an engineer. With that kind of money you can build an LLM server for a dozen people.

One engineer's salary to accelerate a team of twelve is so cheap you can't afford not to.

Open models on-prem is the future, not a single doubt in my mind.

I don't think you need to trust them if you are running on something like bedrock. Then I think you're trusting AWS or whatever cloud equivalent you want.

I think that's true for Sam, not sure about the others.

https://www.openaifiles.org/ceo-integrity

This all depends on the SLA that gets signed.

If a frontier lab is willing to draft an SLA that assumes liability, corporate will pay for it as long as the cost/benefit is in favor of it over insourcing.

Right?

I think the minute a big lab is found to be liable, the whole edifice along with trillions of dollars of investment and VC comes tumbling down. I think that is part of the reason the labs are pushing for more regulation. They can say "We're not liable, we complied with all of the regulations". The actions of multi-billion parameter models trained on data harvested from millions of Internet users over the years can never really be understood - if a business is found to be liable for that, then nobody would ever operate in that space.

Enterprises have barely deployed empowered agents yet. The models capable of doing this have only been available for months. Give it a little time, it's coming.

... when are large companies on the hook for anything, ever?

I mean, hypothetically, yes, but class-action lawsuits get settled out-of-court, the lawyers get paid in Ferrari-multiples, the plaintiffs get paid in McDonalds coupons that expire in two weeks.

Slaps-on-the-wrist are written into the laws; a million-dollar fine is existential for a small company, and likely not even a line-item at Anthropic.

It actually does help a lot to be able to say your OpenAI agent was the fault. People recognize the name. The press doesn't want to write about Better Home Life Insurance agents running loose on the internet, nobody cares.