| ▲ | edf13 12 hours ago |
| Seems to be a very regular occurrence starting around this time of day (14:30 UTC)... Claude Code returning:
API Error: 500 {"type":"error","error":{"type":"api_error","message":"Internal server error"},"request_id":"---"} Over and over again! |
|
| ▲ | walthamstow 11 hours ago | parent | next [-] |
| US Pacific comes online while London is still working and they can't handle it. $380bn valuation btw. |
| |
| ▲ | jjcm 11 hours ago | parent | next [-] | | No amount of valuation can fix global supply issues for GPUs for inference unfortunately. I suspect they're highly oversubscribed, thus the reason why we're seeing them do other things to cut down on inference cost (ie changing their default thinking length). | | |
| ▲ | natpalmer1776 11 hours ago | parent | next [-] | | Remember when OpenAI wasn’t allowing new subscriptions to their ChatGPT pro plans because they were oversubscribed? Pepperidge Farms remembers. | | |
| ▲ | andai 11 hours ago | parent [-] | | Wouldn't that be good? I remember back in the day you could only get Gmail thru an invite, it was an awesome strategy. "Currently closed for applications" creates FOMO. They'd just need to actually get the GPUs in relatively short supply. They could do it in bursts though, right? "Now accepting applications for a short time." I'm not an internet marketer but that sounds like a win win to me. People feel special, they get extra hype, and the service isn't broken. | | |
| ▲ | hirako2000 11 hours ago | parent | next [-] | | In the case of Gmail that was fake scarcity. In the case of Anthropic is fake availability. Sam Altman explained the idea is to scale the thing up, and see what happens. He hadn't claimed to offer a solution to the supply problem that would unfold. | | |
| ▲ | bruckie 8 hours ago | parent | next [-] | | Are you sure it was fake scarcity for Gmail? IIRC they did it because they were worried about systems falling over if it grew too fast, and discovered the marketing benefits as a side effect. | |
| ▲ | iainmerrick 8 hours ago | parent | prev [-] | | Are you mixing up Anthropic and OpenAI here? |
| |
| ▲ | the_gipsy 11 hours ago | parent | prev | next [-] | | Yes, "Pepperidge farm remembers" is usually about how something used to be good. | | |
| ▲ | CoastalCoder 9 hours ago | parent [-] | | Yeah, but there was a spoof on that (in Family Guy?). It was a tie in to the movie "I Know what you Did last Summer", IIRC. |
| |
| ▲ | joquarky 9 hours ago | parent | prev [-] | | Google Wave demonstrated that this doesn't always work. |
|
| |
| ▲ | scratchyone 11 hours ago | parent | prev | next [-] | | maybe, but the response to GPU shortages being increased error rates is the concern imo. they could implement queuing or delayed response times. it's been long enough that they've had plenty of time to implement things like this, at least on their web-ui where they have full control. instead it still just errors with no further information. | | |
| ▲ | skeledrew 10 hours ago | parent | next [-] | | I've been experiencing a good amount of delays (says it's taking extra time to really think, etc), and I'm using during off-peak time. | | |
| ▲ | scratchyone 10 hours ago | parent [-] | | i notice that as well. most of the time when i see those it has a retry counter also and i can see it trying and failing multiple requests haha. almost never succeeds in producing a response when i see those though, eventually just errors out completely. |
| |
| ▲ | hirako2000 11 hours ago | parent | prev [-] | | Coding is a problem solved. Claud writes the code. I edit it. I code around it. Engineer roles dead in 6 months. | | |
| ▲ | post-it 10 hours ago | parent | next [-] | | > I edit it. I code around it. You're never gonna guess what software engineers do. | |
| ▲ | bulbar 8 hours ago | parent | prev | next [-] | | Because of the context I would think this is sarcasm, but I am not sure. | |
| ▲ | 9 hours ago | parent | prev [-] | | [deleted] |
|
| |
| ▲ | AlecSchueler 8 hours ago | parent | prev | next [-] | | > thus the reason why we're seeing them do other things to cut down on inference cost (ie changing their default thinking length). The dynamic thinking and response length is funny enough the best upgrade I've experienced with the service for more than a year. I really appreciate that when I say or ask something simple the answer now just comes back as a single sentence without having to manually toggle "concise" mode on and off again. | |
| ▲ | zachncst 10 hours ago | parent | prev | next [-] | | Sure but we don't need GPUs to log in. | |
| ▲ | sobellian 11 hours ago | parent | prev | next [-] | | Their issues seem to extend well beyond inference into services like auth. | | |
| ▲ | ryandrake 11 hours ago | parent [-] | | Yes. Whenever these outages happen, it always seems that it's their login system that is broken. | | |
| ▲ | bostik 9 hours ago | parent [-] | | That implies that either the auth is too heavy (possible, ish) or their systems don't degrade gracefully enough and many different types of failures propagate up and out all the way to their outermost layer, ie. auth (more plausible). Disclosure: I have scars from a distributed system where errors propagated outwards and took down auth... |
|
| |
| ▲ | paulddraper 8 hours ago | parent | prev [-] | | A. These aren’t rate limit errors from the API. B. Everything is down, even auth. |
| |
| ▲ | ai-x 11 hours ago | parent | prev [-] | | This precisely justifies Anthropic's market cap to be higher. | | |
| ▲ | dsr_ 10 hours ago | parent | next [-] | | Demand at an unsustainably low price does not imply demand at a sustainable price. | | |
| ▲ | bigbadfeline 8 hours ago | parent [-] | | I'm pretty sure ai-x writes sarcasm and skips the /s for pure fun. Personally, I'm amused and I like what he's doing. Others have done it before him though, it's not a new trick. |
| |
| ▲ | tucnak 9 hours ago | parent | prev [-] | | Assuming perfectly efficient business |
|
|
|
| ▲ | azalemeth 11 hours ago | parent | prev | next [-] |
| I literally just came to HN to ask if I was alone with the acurséd "API Error: 500 {"type":"error","error":{"type":"api_error","message":"Internal server error"},"request_id":"…"}" greeting me and telling me to get back to using my brain! |
| |
| ▲ | xnorswap 11 hours ago | parent [-] | | 500-series errors are server-side, 400 series are client side. A 500 error is almost never "just you". ( 404 is a client error, because it's the client requesting a file that does not exist, a problem with the client, not the server, who is _obviously_ blameless in the file not existing. ) | | |
| ▲ | darkwater 11 hours ago | parent | next [-] | | > A 500 error is almost never "just you". I know you added the defensive "almost" but if I had a dollar each time I saw a 500 due to the session cookies being sent by the client that made the backend explode - for whatever root cause - well, I would have a fatter wallet. | | |
| ▲ | xnorswap 11 hours ago | parent | next [-] | | Indeed, and also there's a special circle of hell reserved for anyone who dares change the interface on a public API, and forgets about client caching leading to invalid requests but only for one or two confused users in particular. Bonus points if due to the way that invalid requests are rejected, they are filtered out as invalid traffic and don't even show up as a spike in the application error logs. | |
| ▲ | iainmerrick 8 hours ago | parent | prev [-] | | Depending on what you mean by "made the backend explode", that is a server error, so 500 is correct! Bad input should be a 4xx, but if the server can't cope with it, that's still a 5xx. |
| |
| ▲ | azalemeth 11 hours ago | parent | prev [-] | | I know that in principle this is true. However, I have seen claude shadow-throttle my ipv4 address (I am behind CGNAT), in line with their "VPN" policy -- so I do not trust it, frankly. | | |
| ▲ | paganel 9 hours ago | parent [-] | | > in line with their "VPN" policy This is how I learn that they have a "VPN" policy. Thinking of it maybe it makes sense, that is if it's what I think it is, but seems scummy nonetheless. |
|
|
|
|
| ▲ | andyjohnson0 11 hours ago | parent | prev | next [-] |
| > Seems to be a very regular occurrence starting around this time of day (14:30 UTC)... 8.30am on the US west coast |
|
| ▲ | freedomben 11 hours ago | parent | prev | next [-] |
| Yep, daily haha. Well at least this time they aren't just silently reducing thinking on the server side, which ended up making a mess in my codebase when they did that last time. I'd rather a 500 than a silent rug-pull. |
|
| ▲ | JamesSwift 9 hours ago | parent | prev [-] |
| I tend to notice it around 4pm EST |
