I usually go over to St. John as well. There is a sky tram that goes to the mountain top within walking distance of Havensight Mall/Pier. Awesome views and picture opportunities. Be careful crossing the streets as Dave said.
I have always pretty felt safe on St. Thomas. It is still wise to be careful. I spent some time there after a cruise once. I was told not to walk around at night is all.