An attacker only has to get lucky once, so while I do put SSH on a non-default port too, it's not enough to avoid attacks on its own.

I mostly do it to quiet down the noise from the non-stop bots and scanners.