Two paths.

Give him what he wants (your seat) if you truly just want to clock in there and work in peace as you've indicated.

If you want more than that, it may be time to move on.