Board shorts and flip-flops are for the beach not the workplace. At best you look silly. The older ones look a little sad.
That's persons opinion.
The controllers I know at SOCAL TRACON often surf after working to release stress. Seems to work out ok. No ones swapped paint because they dressed comfortably.