It can be part of defense-in-depth: Move SSH to a nonstandard port and then completely hide it from anyone who does a port scan or tries SSH on the wrong port. I'm sure that's occurred to someone, somewhere in the world.