I think most of the confusion arises because when you are tunneling X via ssh, the X client/server is the reverse of the shh client/server.

Add to that that the user manages the ssh connection while the X connection is managed for them...