I've always struggled to apply this to the systems I work on. If the system fails, someone potentially dies, though in practice they've never been more than hospitalized. To avoid that, huge amounts of effort are expended on failure modelling and testing, but that doesn't eliminate unknown unknowns. That discrepancy has made front page news a couple times.

▲

jedberg 2 hours ago | parent [-]

When I was at Netflix and reddit, one thing I said often was, "Luckily, we are not a bank". And it sounds like you are working on even more critical systems than that.

Chaos engineering doesn't really apply to data critical or safety critical systems. You can't just break them in the real world to see how they fail.

You have it exactly right -- it has to be modeled and tested in lab conditions. Safety critical systems are not a place for YOLO development.

	▲	YZF an hour ago \| parent [-]
		It's still a tool in the tool box. Somewhat analogous to accelerated life testing in non-software products. You induce conditions that make failures more likely to occur.