He's already been impeached twice, with very little coming out of it. Many republicans would have to truly abandon him for any drastic consequences to happen.