VP is an elected official, not appointed by the president.

President could sideline him, but his role in the senate cannot be removed except by impeachment.

Like Trump would not write an executive order to fire JD Vance.