Yes, I agree it does a lot of heavy lifting there.

Honestly that's why it needs to both have strict liabilities on operators/developers (no more "computer said so but computer can't be held liable"), as well as what I mentioned in my example - the failure paths should always go for reliable channel, including connecting to a human simply if it cannot gauge the answer with high enough certainty