You will have a wonderful time and will not be out of place if you dress up all fancy!
We did on our last cruise and it was a lot of fun. I don't get to do that very often. Yes you will see very dressed up people (Formals and Tuxs) also some in very nice church clothes. And everything in between! Just go with what you think is fun and comfortable and have a great time!