If the airport does not have a control tower but lies for example within an Echo to SFC airspace, you can contact the controller to get issued a SVFR clearance out of the airspace.
The VFR minimums are regulations, and are as far as I can see not depending on the PIC agreeing with them or not