If somebody promises to be with one person and only one person and they violate such trust that causes me to doubt their integrity. Couple that with it not just being random women but a spy and people below him in the company (a clear me too situation) and I lose all trust in him.

Before you or somebody says they may have had an open relationship then why did he apologize for hurting his wife? Was he lying? If so, then he has betrayed our trust.