There is no overdressed. You'll see tuxes and full-length ballgowns here and there. Lots of sequins et cetera.
Seems like we made a reservation on formal night on the Spirit, but I don't remember for certain. It is not necessary but waits can be long. Also, if you want formal photography done prior to dinner, factor that in. Lines for that can be very long.