Remix.run Logo
▲ ernubufiei 2 hours ago

I wonder if all these outages are caused by very bad security bugs (AI) being found, rushing out a fix, and there being issues in the fix or the updates surrounding it.

A lot of these systems I suspect are not built to be updated at the velocity current security patches require.

▲al_borland 2 hours ago | parent [-]

This is the tension I'm seeing at work. One side of the business saying, "update everything NOW!!!!", while the other side is saying, "don't you dare skip the 15 levels of approval and testing required to roll that patch out everywhere. You need to coordinate 300 teams to test if you want to roll this out."

Action and inaction both result in job risk, and it's also a race against the clock hoping nothing is exploited while sorting out the politics.

▲robomc 2 hours ago | parent [-]

Yeah it's total victory for the CI devops always-be-deploying people tbh, because everything on the internet needs to be more or less instantly updatable from here on out. Traditional change control is going to seem comically quaint in a few years.

▲al_borland 2 hours ago | parent [-]

I've even seen issues there where the security team wants action today, but the CI process requires waiting for packages to be properly released.