Since when was it accepted practice to wear headgear indoors? Take the damned thing off and tuck it under your left arm! (as opposed to swinging it round like some errant schoolboy).
BTW, my last experience of wearing uniform in public around sunny Cheltenham resulted in my colleague and i being confused for local bus company reps! And I thought I looked rather spiffing in my woolly-pully and FNO badge!