Do you also use a VPN like Tailscale for out-of-home / remote access ?
Steam Remote Play is enough for that, it doesn't need any port forwarding.