It’s not about the affair it never was. He’s being removed likely because he was intimately involved setting up deals circumventing export restrictions. It’s likely the 3 letter agencies knew about it for a long time but it either got too egregious or the political will swung in the favor of action. Either way get affair is the public face of a much more serious infraction