| ▲ | rco8786 9 hours ago |
| Is it me or has there been a very noticeable uptick in large scale infra-level outages lately? AWS, Cloudflare, etc have all been way under whatever SLA they publish. |
|
| ▲ | trollbridge 8 hours ago | parent | next [-] |
| Coincidentally, large tech companies have been conducting mass layoffs and claim they're going to rely on AI much more to replace junior developers. |
| |
| ▲ | MaxHoppersGhost 8 hours ago | parent | next [-] | | And they are offshoring roles to lower quality devs. | |
| ▲ | 6c696e7578 an hour ago | parent | prev | next [-] | | Interestingly, chatgpt was unavailable due to the same cloudflare outage. | | |
| ▲ | creatonez 18 minutes ago | parent [-] | | Imagine vibe coding something in production, it breaks half the internet, then you can't vibe code it back because it broke the LLM providers. A real catch-22 for the modern age! |
| |
| ▲ | xnx 3 hours ago | parent | prev | next [-] | | By similar thinking, you could blame large tech companies if they hired too many juniors. | |
| ▲ | Aurornis 7 hours ago | parent | prev | next [-] | | That does seem to be a coincidence, as the recent outages making headlines (including this one according to early reports) have been associated with huge traffic spikes. It seems DDoS are reaching a new level. | | |
| ▲ | rco8786 6 hours ago | parent | next [-] | | AWS's most recent blow-up was not a DDoS | |
| ▲ | darknavi 4 hours ago | parent | prev [-] | | Maybe a laid-off engineer is bored and started orchestrating DDoS campaigns in their newly-found free time. |
| |
| ▲ | gtsop 7 hours ago | parent | prev [-] | | [dead] |
|
|
| ▲ | alt227 9 hours ago | parent | prev | next [-] |
| For me the only silver lining to all these cloud outages is now we know that their published SLA times mean absolutely nothing. The number of 9's used to at least give an indication of intent of reliability, now they are twisted to whatever metric the company wants to represent and dont actually represent guaranteed uptime anywhere. |
| |
| ▲ | bojangleslover 9 hours ago | parent [-] | | So true. AWS for example gives only platform credits in the event of an outage. Basically no recourse or insurance. | | |
| ▲ | op00to 9 hours ago | parent [-] | | Doesn’t everyone do that? I’ve never worked for a place that the base policy wasn’t credits. You might have special contract language stating otherwise, but for almost everyone, it’s credits. |
|
|
|
| ▲ | AsmaraHolding 8 hours ago | parent | prev | next [-] |
| Some of the other commenters here have posited a "vibe code theory". As the amount of vibe code in production increases, so does the number of bugs and, therefore, the number of outages. |
| |
| ▲ | ACCount37 8 hours ago | parent | next [-] | | None of the recent major outages were traced down to "vibe coding" or anything of the sort. They appear to be the kind of misconfigurations and networking fuckups that existed since Internet became more complex than 3 routers. | | |
| ▲ | Seb-C 8 hours ago | parent | next [-] | | The "vibe thinking" trend where people stop using their brain and rely on whatever random output the LLM tells them is harder to diagnose, but it's certainly there and at least as bad as vibe coding. | | |
| ▲ | Aurornis 6 hours ago | parent [-] | | What about the “vibe thinking” trend where people project their own narratives on to every situation, even if the information available shows that it’s a rise in large scale DDoS attacks? | | |
| ▲ | ACCount37 2 hours ago | parent [-] | | Unfortunately, not a trend. Just human nature. I hope they'll find a fix for that one day. |
|
| |
| ▲ | ceejayoz 7 hours ago | parent | prev | next [-] | | How likely are we to know when a "misconfiguration or networking fuckup" is due to someone asking ChatGPT how to do the task? | |
| ▲ | shufflerofrocks 7 hours ago | parent | prev | next [-] | | >misconfigurations and networking fuckups that existed since Internet became more complex than 3 routers. Yet there has been an uptick in frequency of outages only in the recent few months. Correlation correlation. Why assume that these misconfigs are not the result of someone asking AI how to do them? | | |
| ▲ | voidUpdate 7 hours ago | parent [-] | | Is it a statistically significant uptick though? Random events doesn't mean equally spaced, sometimes there will be more, sometimes there will be less |
| |
| ▲ | davey48016 7 hours ago | parent | prev [-] | | Wasn't the recent AWS a race condition that's existed since before vibe coding was a thing? |
| |
| ▲ | fransje26 7 hours ago | parent | prev | next [-] | | Speaking of "vibe-coding", I wonder how much their own outage is affecting their ability to vibe-code their way out of it.. :-) The openai login page says: Please unblock challenges.cloudflare.com to proceed.
| |
| ▲ | swed420 7 hours ago | parent | prev [-] | | > Some of the other commenters here have posited a "vibe code theory". As the amount of vibe code in production increases, so does the number of bugs and, therefore, the number of outages. Likely this coupled with the mass brain damage caused by never-ending COVID re-infections. Since vaccines don't prevent transmission, and each re-infection increases the chances of long COVID complications, the only real protection right now is wearing a proper respirator everywhere you go, and basically nobody is doing that anymore. | | |
| ▲ | DaSHacka 6 hours ago | parent [-] | | Are you being hyperbolic? It's clearly not this, and very likely not GP's proposal either. | | |
| ▲ | swed420 5 hours ago | parent [-] | | No, and it's easy to find ample research backing it up. | | |
| ▲ | Swannie 6 minutes ago | parent [-] | | Agreed. Most people are not self reflective reflective enough to notice. Need to trust the studies. Far more plausible than the AI ideas. I find it far more likely these are smart people running without oversight for years pre-COVID, relying on being smart at 2am change windows. Now half or a full std. dev. lower on the IQ scale, hubris means fewer guard rails before change, and far lower ability to recover during change window. |
|
|
|
|
|
| ▲ | roxolotl 8 hours ago | parent | prev | next [-] |
| The theory I’ve heard is holiday deploy freezes coupled with Q4 goals creates pressure to get things in quickly and early. It’s all been in the last month or so which does line up. |
| |
|
| ▲ | tristanperry 8 hours ago | parent | prev | next [-] |
| My theory is a state-sponsored actor targeting some of these services, but maybe that's just too 'tinfoil hat' of me, who knows. |
| |
| ▲ | wepple 8 hours ago | parent | next [-] | | There are usually very comprehensive post mortems for these events, and none have suggested that at all | |
| ▲ | bflesch 7 hours ago | parent | prev | next [-] | | This only amplifies the often-repeated propaganda about the "very powerful" enemies of democracy, who in fact are very fragile dictatorships. There's enough incompetence at tech companies to f up their own stuff. | |
| ▲ | rozap 6 hours ago | parent | prev [-] | | My theory is DNS. |
|
|
| ▲ | kqr 8 hours ago | parent | prev | next [-] |
| If it's any guidance, US cyber risk insurance (which covers among other things disruptions due to supplier outages) has continuously dropped in price since Q1 2023, with a handful of percent per year. If you excuse the sloppy plot manually transcribed from market index data: https://i.xkqr.org/cyberinsurancecost.png |
|
| ▲ | zulban 7 hours ago | parent | prev | next [-] |
| Unless you're making that determination statistically, it's probably pereidolia. See here: https://behavioralscientist.org/yates-expect-unexpected-why-... |
|
| ▲ | codethief 9 hours ago | parent | prev | next [-] |
| Don't forget Azure Front Door / half of Azure. |
| |
|
| ▲ | elric 8 hours ago | parent | prev | next [-] |
| I suspect the number of outages is the same, but the number of sites putting all of their eggs into these two baskets has grown considerably. |
|
| ▲ | mikece 8 hours ago | parent | prev | next [-] |
| Any chance our friend Vladamir is behind this? |
|
| ▲ | dimastopel 9 hours ago | parent | prev | next [-] |
| GCP was down recently as well |
|
| ▲ | driverdan 9 hours ago | parent | prev | next [-] |
| It's you. Everything does down once in a while. |
|
| ▲ | chid 8 hours ago | parent | prev | next [-] |
| it definitely feels like it. |
|
| ▲ | guyfromfargo 9 hours ago | parent | prev [-] |
| [dead] |