Remix.run Logo
OpenAI frontier models and Codex are now available on AWS(openai.com)
171 points by typpo 6 hours ago | 57 comments
kylemaxwell 3 hours ago | parent | next [-]

Every time somebody questions why you might "trust" AWS (or Azure or GCP or whatever), or why you'd pay this premium, I realize they are not accustomed to working in enterprise environments.

In my case, I work at a large enterprise with strict data governance built into customer contracts, and (partly related, partly not) our own governance concerns. Using vendors where you not only have infosec permission, but they are also listed as data processors in our contracts with our customers is the way not to get fired and sued.

If I'm playing around at home, with my own code and data, I can do whatever I want. But with my employer and customer? Absolutely not. It's the same reason we don't use whatever is the flavor of the month frontier model is.

Side hustles and startups just have an entirely different set of constraints and considerations.

btown 31 minutes ago | parent | next [-]

On top of this, there's a vast difference between "what do you mean that team spent $1000 on AI in their expense report, what did we get for that?" vs. "oh, the company-wide AWS bill went up by a few percent, let's look into that when we have time." The latter makes projects far more viable.

raincole 21 minutes ago | parent | prev | next [-]

Or to put it simply, nobody ever got fired for buying IBM.

sntran 2 hours ago | parent | prev | next [-]

I have just moved from a free environment in which I was able to use any AI harnesses or models to a strict enterprise environment.

I was shocked to realize how difficult it has been to have a GitHub CoPilot license on Azure. I mean, they're both Microsoft products. But no, the IT now has to figure out how to set up a GitHub enterprise, link to Azure subscription, and all that.

foolfoolz 44 minutes ago | parent | prev [-]

while true, everyone signed this same data privacy agreement with anthropic / openai a long tiem ago

bunderbunder 18 minutes ago | parent [-]

It’s not just that. Oftentimes contracts stipulate that the client’s data can’t be transferred across certain boundaries. If you have signed such an agreement, even sending the data to a service on the same cloud provider but in a different region could be a huge compliance violation.

ykl 4 hours ago | parent | prev | next [-]

If you've used AI coding models in a large corporate setting, you'll know that a lot of big corporate deployments basically require using AWS Bedrock for two simple reasons:

1. Large companies tend to already have an existing relationship with AWS, which makes things way easier to go through vs. setting up a new vendor relationship 2. Large companies tend to have strong internal requirements about making sure that internal data stays under company control. With AWS Bedrock, you can be a lot more confident that what you're feeding into the models is not going to end up in someone's training set somewhere. For where I work, this requirement is a dealbreaker for going directly through OpenAI's API instead of going through AWS Bedrock.

Eridrus 3 hours ago | parent | next [-]

To go a step further, the reason it's often impossible to add a new vendor if that you've signed a bunch of contracts with your customers saying you're not going to send their data to other vendors in all sorts of various flavors.

a_bonobo 2 hours ago | parent | prev | next [-]

3. from my opportunity - For many (not all) LLMs, Bedrock gives you control over which country the data stays in. You have no control over that with the Claude API, for example. We do not work in the US and have strong requirements for the data to stay in our country, which Bedrock gives us control over.

kopirgan 2 hours ago | parent | prev | next [-]

A very interesting comment.

Curious to understand how AI will continue to grow if this is the trend. Assuming most valuable data is behind such firewalls. And whatever is public has been harvested, trained on top of whatever has been acquired illegally (this is a grey area).

Will it become a closed ecosystem without outside input?!

bitmasher9 2 hours ago | parent | next [-]

The pace of data creation is only increasing, and our capabilities of sharing and storing it is growing as well. Lots of this is out in the open, ready for anyone to crawl and scrape.

There probably is a point of “peak data” where the amount of new data will start decreasing, but that’s likely a 22nd or 24rd century problem.

avianlyric an hour ago | parent [-]

Pace of data creation ignores the fact that the majority of the big gains in LLM “intelligence” has come from scraping and feeding in the huge amount of public data that already exists.

Unless we’re producing data on the order of an entire new internet every couple of years, then it’s hard to see how LLMs can achieve further huge leaps in capability compared to training on effectively 0% of the internet vs 100% of the internet.

kennethops 2 hours ago | parent | prev [-]

imo it will slowly turn into where people run their own AI

rho138 4 hours ago | parent | prev [-]

How is one certain bedrock data isn’t being shuttled to external providers?

jofzar 4 hours ago | parent | next [-]

What other people are saying, but also because Amazon does not want to fuck around in this space. They don't want the legal fight or the reputational damage that would come with it.

trollbridge 3 hours ago | parent [-]

They also don't really stand to benefit from doing so, unlike basically everyone else in this space.

They have access to a ridiculous amount of private customer data and so far have not shown any predilection to misusing that access.

xingped 3 hours ago | parent [-]

To take an easy example that has actually had lawsuits I can link to, you must be unfamiliar with the lawsuits against Amazon for misusing sellers' data in order to undercut them with their own products... https://www.reuters.com/sustainability/13-bln-uk-lawsuit-acc...

There's zero reason to "trust" Amazon about anything. (And yes, I know the retail and AWS sides of the company are different, but it's still the same company. The same rot is always there, just shuffled around.)

bijowo1676 3 hours ago | parent | next [-]

this is not related to AWS, but merely to amazon's retail business and their sellers know and sign up for the deal when they sell via amazon.

every single retail company does this, they allow suppliers to sell the product using retails's infrastructure, and then retailer turns around and create private label products using sales data (Costco's Kirkland Signature, Walmart's Great Value, are just some examples)

fragmede 3 hours ago | parent [-]

Yes, but Kirkland's signature comes from the same factory. If I'm the factory owner and Costco vis going to guarantee me sales albeit at a slightly lower margin, so long as I slap a different sticker on it, that's different than from Amazon finding out which of my products sells best and then gets someone else to rip it off so I don't get paid anything.

bijowo1676 3 hours ago | parent [-]

First of all, we don't know which factory kirkland's products are coming from. Even if they are coming from the same factory, who guarantees the same ingredients and quality control was used???

everything from amazon is coming from China, I dont understand why does a random person who resells stuff from Chinese factories via Amazon FBA feels entitled for exclusivity arrangement with Amazon?

Was such exclusivity encoded in some form of legally enforceable agreement ?

trollbridge 2 hours ago | parent | prev [-]

The retail side is completely different from AWS.

nh2 3 hours ago | parent | prev | next [-]

In contrast to Microsoft, OpenAI, and Anthropic, AWS has never done anything close to sneaking in unwanted training opt-outs after the fact.

They are the only ones I trust not to do that so far. And their terms are extremely clear on that, no fuzzy language. Exactly what we want to see. So we use Bedrock.

cortesoft 4 hours ago | parent | prev | next [-]

Contracts and the force of law?

ai_fry_ur_brain 4 hours ago | parent [-]

Which notoriously are always holding the largest corporations accountable /s

harrall 3 hours ago | parent | next [-]

Laws and rules don’t hold anyone accountable. Anyone can say anything and then break that trust the next second.

Instead you trust your best friend because you have known them for 15 years and seen them in enough situations. It’s long term observation and predictability they ultimately gives trust.

AWS has been around 20 years and has never once shown a sign that that they would sell customer data. Could they still try? Sure, in the same way they my friend who hates seafood his entire life could suddenly flip 180 and love it. Yeah I guess it’s possible.

ch4s3 3 hours ago | parent | prev | next [-]

Any sufficiently large company will be prepared to fight this out in court where Amazon would eventually lose.

SOLAR_FIELDS 3 hours ago | parent | prev [-]

Actually yes, when it’s other huge corporations holding them accountable. It’s only when politicians who are much more cheaply bought get involved that creates problems. When the other side has a significant war chest to combat you with, suddenly behavior improves

kopirgan 3 hours ago | parent | prev | next [-]

Having worked with lots of companies, I can say that trust is there. But true test is competitors of Amazon. Does Walmart use them? Ebay? Although not in exact same business.

650REDHAIR 3 hours ago | parent | prev | next [-]

Bezos and Altman pinky-promised and are super trustworthy.

azinman2 3 hours ago | parent | next [-]

Seems like trusting AWS with your data has been a good bet for a long time. They wouldn’t have the size/scale otherwise.

SXX 3 hours ago | parent | prev [-]

Bezos is not in AI gold rush. AWS is shovel rental.

Also unlike Altman they are trustworthy - a lot of Amazon competitors do run on AWS for decades.

avianlyric 4 hours ago | parent | prev | next [-]

Contractual obligation, external third party audits, and above all, AWS’s reputation.

AWS isn’t going to risk their reputation, and thus huge chunks of their business, just so a few AI labs can get some extra training data. That’s an insane risk with zero upside for AWS. AWS knows full well they will make insane quantities of cash without breaking legal contracts with companies who pay them billions each year for infra.

zmmmmm 2 hours ago | parent | prev | next [-]

They could be lying with all this:

https://docs.aws.amazon.com/bedrock/latest/userguide/data-pr...

But it seems tremendously unlikely with how explicit they are being with it. It is clearly one of the top selling features for the service.

33MHz-i486 3 hours ago | parent | prev [-]

they’re crap on a lot dimensions of how they treat customers but data privacy/security is one thats taken pretty seriously at AWS, perhaps owing to the massive reputational damage that would result if they played loose with it.

Aurornis 4 hours ago | parent | prev | next [-]

If you are wondering why anyone would spend more money to use these APIs through AWS instead of going direct: In some companies it’s nearly impossible to get new vendors approved. If the company has an AWS contract then you have to use what AWS offers.

morpheuskafka 3 hours ago | parent | next [-]

Every CEO, board, and middle manager in the world is AI buzzword-obsessed now. Surely asking to sign a contract with the frontier labs directly would not get held up?

crubier 18 minutes ago | parent | next [-]

The hard part is not the CEO, it's the CISO

stronglikedan 2 hours ago | parent | prev [-]

Every CEO, board, and middle manager in the world still has to go through infosec in large orgs.

powvans 4 hours ago | parent | prev [-]

Even if you can get it approved you are adding surface area to your annual security audits, adding another vendor that needs to be disclosed on security assessments, spreading your data to yet another processor, and adding another invoice and budget discussion. Depending on your customer contracts you may need to notify them of a new vendor. This might trigger a new security review. Oh it’s just another model on Bedrock? Bliss.

chopete3 17 minutes ago | parent | prev | next [-]

This is the best thing to happen to AwS. Aws won't push their junk Bedrock equivalents at least.

Enterprises can focus on paying for AWS OpenAI models and get going.

whatever1 an hour ago | parent | prev | next [-]

Frontier labs provide “frozen” builds of their models that hyperscalers just serve without collecting data. This is a prerequisite from most of the companies that store sensitive data and still want to use frontier LLMS.

iandanforth 3 hours ago | parent | prev | next [-]

This is a great move for OpenAI and one that should worry Anthropic. Bedrock was the only way I could use foundation models for a while given AWS lock-in and security requirements.

phillipcarter 4 hours ago | parent | prev | next [-]

Absolutely huge news for OpenAI. Unimaginable amount of enterprises picked up Claude just because it was available in AWS, and now there's serious competition.

rohansood15 an hour ago | parent | prev | next [-]

Anthropic better get that IPO out soon. Their incredible revenue run-up was basically a result of botched Gemini releases and OpenAI having their hands-tied behind their Azure backs.

Anthropic models were quite literally the only viable serverless API (i.e. Bedrock) models on AWS. They didn't even bother releasing the recent Qwen 3.5/3.6 series. Combined with the token efficiency/ROI focus, I would really like to see how Antrhopic ends Q3.

chasd00 an hour ago | parent | prev | next [-]

Sucks for Azure. They were the chosen one but couldn’t keep up with demand. Once OpenAI got out of that exclusivity deal saying Azure wasn’t reliable I knew AWS was where they were headed.

2001zhaozhao 3 hours ago | parent | prev | next [-]

Good news for competition.

Claude Code keeps omitting new features from people using it through Amazon Bedrock (e.g. auto mode, ultra plan, Claude for Chrome). Hopefully some more competition can get them to rethink their strategy.

gordonhart 2 hours ago | parent | prev | next [-]

Are they? I don't see them in the Model Catalog on Bedrock.

AgentOrange1234 3 hours ago | parent | prev | next [-]

This is great news. I wish they were keeping their other models updated. With Gemma 4 and Qwen 3.7 already available on OpenRouter, bedrock is just not keeping up at all.

jgbuddy an hour ago | parent | prev | next [-]

great for consumers, great for OpenAI, great for Amazon, not so great for MS / Azure (seems like they don't care anyways)

_pdp_ 4 hours ago | parent | prev | next [-]

As usual the more options the better for everyone. While this is not a direct replacement it is good that it exists.

hooch an hour ago | parent | prev | next [-]

No 5.5 Pro

Handy-Man 4 hours ago | parent | prev [-]

More expensive than directly sourcing from OpenAI

easton 4 hours ago | parent | next [-]

The AWS pricing page says 10% more than OpenAI, which is probably because they’re forcing all inference through the US and data residency is at a 10% premium from the model vendors for whatever reason (because you’ll pay for it).

If they put in a global endpoint like with Claude (or OpenAI directly) then it’ll probably match the direct pricing, if the pattern holds.

(https://aws.amazon.com/bedrock/pricing/, scroll to OpenAI)

cebert 3 hours ago | parent | next [-]

It’s even more expensive for GovCloud customers. We pay a 30% premium on top of that.

sokoloff 4 hours ago | parent | prev [-]

It also could be to provide room for enterprise discount pricing without it being money-losing for one of the companies.

yojo 3 hours ago | parent [-]

I have worked at places that have negotiated flat percentage discounts on all AWS spend.

This explanation seems plausible to me.

BoredPositron 4 hours ago | parent | prev [-]

It's for people that can easily pump their AWS bill but not a new vendor.