I don't think safety is the biggest issue with hurricanes. I know that sounds crazy, but like Carol said the cruiselines are top notch when it comes to planning, avoiding and adjusting for them. So, I won't be concerned about that aspect.
However, the possible downside is that your itinerary will be changed. This happened to us and we lost the chance to go to Princess Cays which was damaged badly during the hurricane season. We were really looking forward to a private beach day.
On the up side, we went to San Juan instead and enjoyed a great city and beach tour for $10 a person! Was a great little quick stop, and what a view when you sail in!