> Your X network traffic would be clear text over the network if you did it this way.

that's exactly what I want on my local home network

You will also need to xhost +(host) which has its own problems.