You set up Tailscale as a split tunnel so requests to your own server go through the vpn while everything else does not.