If you publicly humiliate your family and the business, you're out...

It's not entirely about humiliation.

Having an affair (or multiple, in this case) demonstrates poor decision making. You don't want someone who can't make wise choices running your company.