I fly for a living, have done so for 32 years now; it's my present company uniform and I was on duty. No-one objected or even mentioned it. If they had, as a paying visitor I would have told them where to stick the club's unwritten rules, as any reasonable person would, especially in the circumstances.
I repeat again - the issue on the day was that my passenger strongly objected to the way he was treated on arrival. He didn't go to use the club or its facilities (nor did I), merely to get to a further destination.
Suggest you and your pax are more suited for the VIP area at EGLL or maybe EGWU, you pay a little more but they give you large amounts of respect & are used to people arriving in all sorts of uniform, from Crowns & even down to orange boiler suits