Middleboxes are not relevant in this scenario.

Uh, why not? Unless your SSH client is on the same network as theirs, there are going to be middleboxes somewhere in the path.