I think every N days a chaos monkey event should happen for every business to help with this kind of issue. If a SaaS takes your business offline, you aren't resilient.

https://netflix.github.io/chaosmonkey/

▲

dhbradshaw 5 hours ago | parent | next [-]

This is a good argument for encouraging employee vacations as well. Makes a more resilient company when nodes occasionally turn off.

	▲	6510 4 hours ago \| parent [-]
		It's 2036, every few months we boot up the Microsoft and quickly take as many pictures as we can of sheets, docs, slide shows, work schedules, support questions, we run payroll etc The AI is the only one left who can still log in using a combination of free trials and an intern admin account from someone in India we've long since lost track of. Rumor has it he now lives alone in the old temple at the top of the mountain.

▲

imglorp 5 hours ago | parent | prev [-]

Props to anyone that can build a system mature enough to withstand a chaos monkey element running loose in prod. Brilliant.

▲

antod 4 hours ago | parent [-]

We've moved on since then, the system is now built by a chaos monkey running loose in prod.

	▲	noir_lord 3 hours ago \| parent [-]
		No, that was a couple of years ago. Now we have hordes of chaos monkeys running loose in prod managed by supervisor chaos monkeys who write the code running in prod.