How many companies at the size of Anthropic can serve the amount of traffic and manage the amount of compute they have?

Let's be honest - they're also still hiring software devs. AI still requires skilled humans in the loop and that's not going away.

This is just like any extreme engineering domain. I am okay with occasional delays in Flights, as long as it takes me from X to Y in 10hrs vs months.

i know the dream for capitalists is to be able to point an llm at something and say "do and/or fix it" but we still can't even get them to not go quite literally insane if allowed to run for an extended period of time

and you can only kill weyoun, awaken the next vorta clone and have him 'catch up' on all that its missed so many times before they just end up with a complete mess, so. uh. yeah.

doubt they can just "fix" their problems like that.

I’m on the biggest max plan. It is riddled with annoying bugs for me, only been using it for a little over a month. Settings screen flashes randomly. But most annoyingly: sometimes when forking chats or sometimes for no reason, the UI just straight up eats my previous messages. The model is still aware of them and can recount them if I ask but the visible history is gone. And that’s not even all of them. Fable 5 is just too good that I put up with it but it seriously raises concerns for me that even with infinite compute these companies can’t even deliver a functional chat UI.

No idea but we have few Team Premium seats and everyone is encountering issues daily for past two weeks. From straight up outages to vscode extension/CLI refusing to process messages. It's been unusable for most of our work hours past two days.

I’m using both side by side, my employer pays by the token and I have a Max 20x plan.

They start hitting timeouts or API errors at the same time on two different computers. As far as I can tell it’s the exact same infrastructure.

I think you’re just lucky. Look at the Claude status page to see just how often they have outages (it’s almost daily). Even most of the green days have issues if you hover over them, they just don’t count them as outages.

The code it outputs, yes! It's fantastic. It's just so frustrating that the product and UX before the code output is so bad. Greatness is so close within their reach, if only they invested in product and QA people.

Fixing such issues requires software and site reliability engineering, of which coding is just a part.

The first page of the score card mentions that this model is not capable to replace engineers.