I have the same problem at EGNM. Even when the weather seems fine and nothing serious on the TAF. They are good with excuses.
Im a PPL so, i hire them out, they dont let us go if the vis is less than 15k, and if the crosswind component is more than 14kt, they get very funny bout it, even though the Robin limit is 18kt.
They are so expensive and find any excuse not to let you go. I haven't flown for 4 weeks now.
I no you have to be safe, but they take the biscuit sometimes, I think if the weather is in safe limits of the aircraft, pilot, and within the qualification of the licence, I don't see a problem.