As a civilian, I saw no problem within the part of the organisation in which I served. As an example, HQ RAFG.
The potential problems were those external to the comfort zone, where I could see who was who at a glance, but airmen at the gates of the Clutch etc were less than courteous on occasion. As my gopher/driver was often in his RAF[VR] Flt Lt uniform, that could grate. And me wearing a tie!
No remedy, just suck it up and look at the paycheque.