cdb,
If you are operating a normal flight IFR or VFR and are refused your routing request under IFR or VFR then you can report the matter and it will be looked at.
If you can not fly VFR or IFR then you rely on the goodwill of the ATCO on the day to let you fly Special VFR.
In the case of SVFR there is nothing stopping an individual ATCO deciding that for them SVFR is dangerous and thus they will no longer approve it (ever). They have the ANO and the AIP and MATS to back them up because it is totally at ATC's discretion........unlike VFR or IFR.
Extreme but legal and backed up by the rules.
Regards,
DFC