How many in your party? $150 pp. from the city to the port sounds high. If there are enough of you I would think you could rent a private shuttle for less than the ship transfer.
I would also look closer at the train; many have said here how easy it is--and safe.