Remix.run Logo
gavinray 3 hours ago

I recently wound up in conversation with someone working at Amazon. Inevitably, the convo steered into AI/LLM's at some point.

Here is what I learned:

- AWS had an in-house LLM tool that was terrible they tried to use for a while

- A lot of them still use Kiro

- Claude Code is currently the de-facto standard

- They're in the process of getting some custom Codex variant that doesn't phone-home and is audited approved

- There's no mandated organizational standard for what exact tools to some, various teams have different levels of adoption and stacks

- No org-wide/team-wide conventions for Claude Code

- They do have token budgets

- There's an intenral push for something called "Agent Spaces" which was described to me as a sort of Lovable/Bolt-type thing if I understood it right

I can't validate all of this and I might have misremembered, but just in case anyone else finds it interesting.

pinkmuffinere an hour ago | parent | next [-]

> There's no mandated organizational standard for what exact tools to some, various teams have different levels of adoption and stacks

> No org-wide/team-wide conventions for Claude Code

Just for context, this pattern (different teams using different tools in different ways) is extremely normal within Amazon, and is intentional. These shouldn't necessarily be seen as a failure. Amazon likes to have multiple competing options they use for everything, and they constantly evaluate which option is best performing, like an A/B test. After a couple years they will pare away whatever performs worst, replacing it with a new option. This strategy definitely has it's disadvantages, but it is an intentional chosen pattern throughout the company.

Source: I worked there for 5 years, and painfully/tearfully remember the transitions chime -> slack -> teams and workdocs -> quip -> confluence :')

antonvs 13 minutes ago | parent [-]

How does anyone intentionally decide to migrate to Teams?!

I've only ever seen it in Microsoft shops that used it from the beginning.

noisy_boy 2 hours ago | parent | prev | next [-]

I am more curious about how much token budget they have. Here I have to beg my boss for more as if he is paying from his pocket or I am using it for my hobby projects (I am not). I guess time to go back to copy/pasting to chat and doing things by hand like a caveman.

garciasn 2 hours ago | parent [-]

I don't understand this token budget shit. Why would anyone, in their right mind, not be using Claude Max? All of the engineers at our org are using 6.25x and several heavy non-developers are as well. The rest of the company with licenses are using 1.25x.

I have hit my 6.25x limit exactly once in the last quarter.

---

I realize that we will all eventually be forced to pay more for this and I have raised it as a real possibility to the org for budgeting scenario planning; however, for now, why would you pay by token when it's subsidized?!

e: I now understand; you can stop downvoting.

mrgaro 2 hours ago | parent | next [-]

In order to get enterprise agreement you need to pay per token for Claude.

garciasn 2 hours ago | parent [-]

Ah; I didn't realize there was a 150 person cap to Team and I suppose paying out the ear is worth it for compliance audit. Makes sense in that regard.

disgruntledphd2 2 hours ago | parent | prev | next [-]

> I realize that we will all eventually be forced to pay more for this and I have raised it as a real possibility to the org for budgeting scenario planning; however, for now, why would you pay by token when it's subsidized?!

Anthropic (and maybe OpenAI?) have gated all the important enterprise features behind API plus pricing in the last quarter or two.

2 hours ago | parent | prev | next [-]
[deleted]
dastbe 2 hours ago | parent | prev | next [-]

because they’re not; anthropic is pushing enterprises to switch to API/token pricing

mrguyorama 2 hours ago | parent | prev [-]

For the code I generate and the limited way I am using it, Claude Sonnet is reliable and good.

I hope that I can someday run something very much like it locally.

The moment that happens, the AI industry is essentially useless to me. I don't need some ultra expensive "Totally better" model that does the exact same thing.

sparrc an hour ago | parent | prev | next [-]

I work at AWS, we got access to Claude Code very recently, most people are using Kiro and that seems to be the defacto standard.

I have not heard of any nor run into any token budgets.

There is generally a lot of team-wide usage of CLAUDE.md/AGENTS.md, team-specific skills, oncall skills, etc.

Not as much org-wide, although my org has an MCP server built for helping with oncall.

Ancalagon an hour ago | parent | prev | next [-]

> There's an intenral push for something called "Agent Spaces" which was described to me as a sort of Lovable/Bolt-type thing if I understood it right

Everyone and their mother making vibe-app platforms for their company API's now

tyingq 2 hours ago | parent | prev | next [-]

Would be really curious what the internal market share for Kiro is. Not a really good look for it if it's just smattering use here and there.

8note an hour ago | parent | prev | next [-]

assuming it hasnt changed, agent spaces is just a developer desktop running on actual aws rather than on internal hosts, and they figured out how to put vscode on it in a security approved way, including your employee credentials.

one of the things that allows is for adding mcps, skills, and various harnesses that are preconfigured to work out of the box.

i doubt its gotten out of the employee needing to sign in every couple hours

add-sub-mul-div 2 hours ago | parent | prev [-]

From the outside it always seems laughably circuitious compared to just learning skills ourselves.

Even if it did let me fill out TPS reports 20% faster, who even cares compared to all of this chaos?

dfee 2 hours ago | parent | next [-]

the problem is scale. there's a tension between an individual developing technical skills (transfer cost is high, slow, expensive) and developing agent skills (transfer cost is low, instant, free).

so, just like a manager manages employees, or you consult a contractor, agents are a way of getting leverage over a system.

that said, if you want to learn to play saxophone, you're free to do so. just note your personal endeavors may begin to look more like hobbies than marketable skills.

rustystump 38 minutes ago | parent [-]

When the cost for this leverage is more than an employee the math stops mathing.

Additionally, for tech work. There is a tension about doing work and not knowing that output is correct or not. I have seen ai spit out thousands of lines of opencv code for a simple color lut. The person doing this had no idea what was going on. If they continued, the token cost and time waiting for agents spinning only goes up.

Yes, agents get smarter and cheaper but the above example replays over and over again even on crud apps. You still need to dev the skills and transfer costs for it to be effective.

wahnfrieden 2 hours ago | parent | prev [-]

Shareholders want the company to figure out how to pay fewer employees, and pay them less by down-skilling them