Because physical movement is intuitively transitive. Going from A to B then B to C is the same as going from A to C.

The journey from Y to Z might feel more tiring than the journey from A to B, but only if you do them all in one day :)