> I'm guessing that without using Mythos, those conversations would never have been had, and confidence in the compliance of the product would've been lower.

The conversations had already been had and the product made compliant. Mythos just pulled new rules out of its ass and of course the product wasn't compliant with those. So they do a fire drill and find that to be the case at great expense.

Yeah you can frame it as "more checking is always better" if you wanted but that's just the same old "other people's resources are valueless" slight of hand we see on everything. It probably was mostly wasteful work.

There's a chapter in Simple Sabotage about how to undermine a white collar organization from the inside. One of the key tactics is to hold meetings that revisit decided upon points, and to invent unnecessary process / checking.

So, in this case, the LLM's behavior was equivalent to the behavior of the resistance during WWII.

I think that book should be required reading for all engineering students.