They also will alternate it on occasion so maintenance, painting, and cleaning can be performed on the side facing outboard. As Cruise Fanatic said, the usual sight is just some buildings, lines of buses and cabs, etc. It simply isn't a factor to use in cabin selection for your cruise.
Dave, I really enjoy watching the activities in Port and it's always fun to watch the late arrivals sprint down the pier. I agree, it's not the most important factor to consider when booking a balcony but one worth thinking about for me. According to my TA, it's a common request.
The funniest thing is watching the late arrivals from the Lido deck. I get some lunch and look over to see them making a dash for the ship.
On my last cruise on the Norwegian star, we were literally the last passengers on the ship. The airline lost our luggage - a 50 seat Dash-8 flight from Vancouver and no luggage ever appeared in the terminal. I had to wait 2 hours for the next flight to come in and make sure my bags were not on it. Just as I returned to the NCL departure point, the second last bus was just pulling away. I had to catch the very last bus to the pier. Just as we came aboard, everyone was lining up for the lifeboat drill.