welcome to Cruise-Chat.com!
Bottled water is not free. This does also apply to the bottle you will find in your cabin.
While it is difficult to predict how the tap water tastes, it has always been okay for me and I am particularly not used to chlorinated water as we have an excellent water quality where I live.
You can get tap water free of charge around the clockin the Windjammer Café (buffet restaurant) on all RCI ships.