Remix.run Logo
xyproto 2 hours ago

Yes.

Weird that https://www.cloudflarestatus.com/ isn't reporting this properly. It should be full of red blinking lights.

javier2 2 hours ago | parent | next [-]

Yeah. I only work for a small company, but you can be certain we will not update the status page if only a small portion of customers are affected, and if we are fully down, rest assured there will be no available hands to keep the status page updated

s_dev 2 hours ago | parent | next [-]

>rest assured there will be no available hands to keep the status page updated

That's not how status pages if implemented correctly work. The real reason status pages aren't updated is SLAs. If you agree on a contract to have 99.99% uptime your status page better reflect that or it invalidates many contracts. This is why AWS also lies about it's uptime and status page.

These services rarely experience outages according their own figures but rather 'degraded performance' or some other language that talks around the issue rather than acknowledging it.

It's like when buying a house you need an independent surveyor not the one offered by the developer/seller to check for problems with foundations or rotting timber.

redm an hour ago | parent | next [-]

SLA’s usually just give you a small credit for the exact period of the incident, which is arymetric to the impact. We always have to negotiate for termination rights for failing to meet SLA standards but, in reality, we never exercise them.

Reality is that in an incident, everyone is focused on fixing issue, not updating status pages; automated checks fail or have false positives often too. :/

laurent123456 2 hours ago | parent | prev | next [-]

This is weird - at this level contracts are supposed to be rock solid so why wouldn't they require accurate status reporting? That's trivial to implement, and you can even require to have it on a neutral third-party like UptimeRobot and be done with it.

I'm sure there are gray areas in such contracts but something being down or not is pretty black and white.

franga2000 an hour ago | parent | next [-]

> something being down or not is pretty black and white

This is so obviously not true that I'm not sure if you're even being serious.

Is the control panel being inaccessible for one region "down"? Is their DNS "down" if the edit API doesn't work, but existing records still get resolved? Is their reverse proxy service "down" if it's still proxying fine, just not caching assets?

remus an hour ago | parent | prev [-]

> I'm sure there are gray areas in such contracts but something being down or not is pretty black and white.

Is it? Say you've got some big geographically distributed service doing some billions of requests per day with a background error rate of 0.0001%, what's your threshold for saying whether the service is up or down? Your error rate might go to 0.0002% because a particular customer has an issue so that customer would say it's down for them, but for all your other customers it would be working as normal.

lucianbr 2 hours ago | parent | prev | next [-]

Are the contracts so easy to bypass? Who signs a contract with an SLA knowing the service provider will just lie about the availability? Is the client supposed to sue the provider any time there is an SLA breach?

netdevphoenix an hour ago | parent | next [-]

Anyone who doesn't have any choice financially or gnostically. Same reason why people pay Netflix despite the low quality of most of their shows and the constant termination of tv series after 1 season. Same reason why people put up with Meta not caring about moderating or harmful content. The power dynamics resemble a monopoly

ozim an hour ago | parent [-]

Most of services are not really critical but customers want to have 99.999% on the paper.

Most of the time people will just get by and ignore even full day of downtime as minor inconvenience. Loss of revenue for the day - well you most likely will have to eat that, because going to court and having lawyers fighting over it most likely will cost you as much as just forgetting about it.

If your company goes bankrupt because AWS/Cloudflare/GCP/Azure is down for a day or two - guess what - you won't have money to sue them ¯\_(ツ)_/¯ and most likely will have bunch of more pressing problems on your hand.

heipei an hour ago | parent | prev | next [-]

The client is supposed to monitor availability themselves, that is how these contracts work.

immibis an hour ago | parent | prev [-]

The company that is trying to cancel its contract early needs to prove the SLA was violated, which is very easy of the company providing the service also provides a page that says their SLA was violated. Otherwise it's much harder to prove.

8cvor6j844qw_d6 2 hours ago | parent | prev | next [-]

I imagine there will be many levels of "approvals" to get the status page actually showing down, since SLA uptime contracts is involved.

javier2 an hour ago | parent | prev [-]

I work for a small company. We have no written SLA agreements.

lawnchair 2 hours ago | parent | prev | next [-]

I have to say that if an incident becomes so overwhelming that nobody can spare even a moment to communicate with customers, that points to a deeper operational problem. A status page is not something you update only when things are calm. It is part of the response itself. It is how you keep users informed and maintain trust when everything else is going wrong.

If communication disappears entirely during an outage, the whole operation suffers. And if that is truly how a company handles incidents, then it is not a practice I would want to rely on. Good operations teams build processes that protect both the system and the people using it. Communication is one of those processes.

onion2k an hour ago | parent | prev | next [-]

if we are fully down, rest assured there will be no available hands to keep the status page updated

There is no quicker way for customers to lose trust in your service than it to be down and for them to not know that you're aware and trying to fix it as quickly as possible. One of the things Cloudflare gets right is the frequent public updates when there's a problem.

You should give someone the responsibility for keeping everyone up to date during an incident. It's a good idea to give that task to someone quite junior - they're not much help during the crisis, and they learn a lot about both the tech and communication by managing it.

2 hours ago | parent | prev | next [-]
[deleted]
GoblinSlayer 2 hours ago | parent | prev [-]

You won't be able to update the status page due to failures anyway.

PhilippGille 31 minutes ago | parent [-]

Why not? A good status page runs on a different cloud provider in a different region, specifically to not be affected at the same time.

63stack 2 hours ago | parent | prev | next [-]

This is just business as usual, status pages are 95% for show now. The data center would have to be under water for the status page to say "some users might be experiencing disruptions".

csomar 2 hours ago | parent | next [-]

They just did an update, and it is bad (in the sense that they are not realizing their clients are down?)

> Investigating - Cloudflare is investigating issues with Cloudflare Dashboard and related APIs.

> These issues do not affect the serving of cached files via the Cloudflare CDN or other security features at the Cloudflare Edge.

> Customers using the Dashboard / Cloudflare APIs are impacted as requests might fail and/or errors may be displayed.

Eikon 2 hours ago | parent [-]

> (in the sense that they are not realizing their clients are down?)

Their own website seems down too https://www.cloudflare.com/

--

500 Internal Server Error

cloudflare

mikkom 2 hours ago | parent [-]

>Customers using the Dashboard / Cloudflare APIs are impacted as requests might fail and/or errors may be displayed.

"Might fail"

yapyap 2 hours ago | parent | prev [-]

well it does say that now, so…

which datacenter got flooded?

rvnx an hour ago | parent [-]

> In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Dec 05, 2025 - 09:00 UTC

It's a scheduled maintenance, so SLA should not apply right ?

darccio 2 hours ago | parent | prev | next [-]

https://updog.ai/status/cloudflare reported the incident 13 minutes ago (at the moment of writing this).

chironjit 2 hours ago | parent | prev | next [-]

Yeah, their status site reports nothing but then clicking on some of the links on that site bring you the 500 error

mikkom 2 hours ago | parent | prev | next [-]

Company internal status pages are always like this. When you don't report problems they don't exist!

Havoc 2 hours ago | parent | prev | next [-]

It’s wild how non of the big corporations can make a functional status page

javier2 2 hours ago | parent | next [-]

They could, but accurate reporting is not good for their SLAs

dncornholio 2 hours ago | parent | prev [-]

They can. They don't want to though.

hinkley 2 hours ago | parent | prev | next [-]

They were intending to start a maintenance window starting 6 minutes ago, but they were already down by then.

dinoqqq 2 hours ago | parent | prev | next [-]

There is an update:

"Cloudflare Dashboard and Cloudflare API service issues"

Investigating - Cloudflare is investigating issues with Cloudflare Dashboard and related APIs.

Customers using the Dashboard / Cloudflare APIs are impacted as requests might fail and/or errors may be displayed. Dec 05, 2025 - 08:56 UTC

rollulus 2 hours ago | parent | prev | next [-]

Not weird, that’s tradition by now.

jbuild 2 hours ago | parent | prev | next [-]

Interesting, I get a 500 if I try to visit coinbase.com, but my WebSocket connections to advanced-trade-ws.coinbase.com are still live with no issues.

emakarov 2 hours ago | parent [-]

probably these websockets are not going through cloudflare

fxd123 2 hours ago | parent | prev | next [-]

> Investigating - Cloudflare is investigating issues with Cloudflare Dashboard and related APIs.

They seem to now, a few min after your comment

redm 2 hours ago | parent [-]

Im much more concerned with customer sites being down which indicates are not impacted. They are.. :/

csomar 2 hours ago | parent | prev | next [-]

> In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Dec 05, 2025 - 07:00 UTC

Something must have gone really wrong.

headmelted 2 hours ago | parent | next [-]

It's 1AM in San Francisco right now. I don't envy the person having to call Matthew Prince and wake him up for this one. And I feel really bad for the person that forgot a closing brace in whatever config file did this.

artlovecode 2 hours ago | parent | next [-]

Agreed, I feel bad for them. But mostly because cloudflare's workflows are so bad that you're seemingly repeatedly set up for really public failures. Like how does this keep happening without leadership's heads rolling. The culture clearly is not fit for their level of criticality

esseph an hour ago | parent [-]

> The culture clearly is not fit for their level of criticality

I don't think anyone's is.

everfrustrated an hour ago | parent [-]

How often do you hear of Akamai going down and they host a LOT more enterprise/high value sites than Cloudflare.

There's a reason Cloudflare has been really struggling to get into the traditional enterprise space and it isn't price.

inferiorhuman 33 minutes ago | parent [-]

A quick google turned up an Akamai outage in July that took Linode down and two in 2021. At that scale nobody's going to come up smelling like roses. I mostly dealt with Amazon crap at megacorp, but nobody that had to deal with our Akamai stuff had anything kind to say about them as a vendor.

At first blush it's getting harder to "defend" use of Cloudflare, but I'll wait until we get some idea of what actually broke. For the time being I'll save my outrage for the AI scrapers that drove everyone into Cloudflare's arms.

viraptor 2 hours ago | parent | prev | next [-]

> I don't envy the person having to call Matthew Prince

They shouldn't need to do that unless they're really disorganised. CEOs are not there for day to day operations.

csomar 2 hours ago | parent | prev [-]

> And I feel really bad for the person that forgot a closing brace in whatever config file did this.

If a closing brace take your whole infra. down, my guess is that we'll see more of this.

shafyy 2 hours ago | parent | prev [-]

Life hack: Announce bug that brings your entire network down as scheduled maintenance.

jonathanlydall 2 hours ago | parent | prev | next [-]

Now showing a message, posted at 08:56 UTC.

jachee 2 hours ago | parent | prev | next [-]

Management is always going to take too long (in an engineer’s opinion) to manually throw the alerts on. They’re pressing people for quick fixes so they can claim their SLAs are intact.

devmor an hour ago | parent | prev | next [-]

Yes, the incident report claims this was limited to their client dashboard. It most certainly was not. I have the PagerDuty alerts to prove it...

tjpnz 2 hours ago | parent | prev | next [-]

They have enough data to at least automate yellow.

rvz 2 hours ago | parent | prev | next [-]

The AI agents can't help out on this time.

rifycombine1 2 hours ago | parent [-]

maybe we can back to stackoverflow :)

an hour ago | parent [-]
[deleted]
2 hours ago | parent | prev | next [-]
[deleted]
tommek4077 2 hours ago | parent | prev [-]

Yes, it’s really ‘weird’ that they refuse to share any details. Completely unlike AWS, for example. As if being open about issues with their own product wouldn’t be in their best interest. /s