Remix.run Logo
mgambati a day ago

The inertia is legal and financial. People are paying Anthropic through AWS accounts because the simple reason of not dealing making new contract and legal agreements is enough of reason of the inertia.

But, eventually, I’m quite sure that AWS will also provide open models with those contracts without any inertia. Copilot is already offering Kimi.

My company has a deal with Devin and they provide new models all the time, and open models are becoming the most used ones by our internal metrics, especially because the company is very worried about cost.

zmgsabst a day ago | parent | next [-]

AWS already supports Llama and GLM in its Bedrock service for hosted models.

They’re much cheaper to run, eg, Llama 3.3 Instruct 70B is 5-10x cheaper than Sonnet 5.

https://aws.amazon.com/bedrock/pricing/

Say you have 20% of usecases that require the more expensive model — but in 80% you could just use Llama instead of Sonnet (eg, for basic queries of a document). That saves 80% of that 80%, or 65% of your total bill!

That is the kind of “swap” that’s likely to occur in automated tooling as pricing pressure kicks in — “can you save 65% on our AI bill by switching Bedrock over in 80% of uses?”

regularfry a day ago | parent [-]

Bedrock is really out of date with the models it offers, to the extent that I'm not sure they even have plans to update what's on there now they have the deal with Anthropic. They're still offering Qwen 3, not even 3.5 and certainly not 3.6. GLM 5 is the newest z.AI model they have, when it's 5.2 that would be the one to worry Sonnet.

There are some ok models on there (Qwen 3 Coder Next is usable and fast, for instance) but the lack of updates in a fast-moving field makes it something I don't want to recommend to my org.

whattheheckheck 17 hours ago | parent [-]

Because these models are not going to stand up legally

regularfry 14 hours ago | parent [-]

That's a stretch but it doesn't change the outcome.

skeptic_ai a day ago | parent | prev [-]

Also they pay for legal liability of code produced

Yizahi 13 hours ago | parent [-]

Maybe for a fantasy of legal liability of output produced. I haven't heard of any LLM corpo being held liable for any output they generate. Even NYT lawsuit is going nowhere for 3 years in courts already, despite being the most grounded.