Hey Captjns,
There's no regulation that states that you specifically can not.
however the explanation is a little circuituous
but the reason that in controlled airspace we have basic VFR weather minima is NOT to protect pilots from themselves but rather to protect those operating in controlled airspace so that when a certain amount of cloud cover or visibilty prevails everone is under positive ATC control; also, in the US visual contact with the ground is not required[except for some limited licences i.e sport pilot, ultralights]
furthermore visibilty as reported is slant range visibility and the refractive effects of haze, lack of good sky ground contrast etc.. can cause a legal visibilty and it can be cloudless, for example, yet the natural horizon is non-existent requiring Instrument flying techniques-so the basic reason for VFR mins are
1. to allow IFR and VFR traffic the ability to see and avoid one another without being unduly restrictive
2. to set a final minima where all traffic operating within the specific class of controlled airspace must be positively controlled
Historically, basic US basic flight rules come from the Avigation Act of 1926?
written in blood-of course
going back to the old axiom of "what is legal is not always safe and vice versa]" there is not regulation that stops a newly minted PPL with no IR to take off over-water on a moonless night with little backgound lighting as long as he wont hit anybody--the burden of flying is on the PIC---there's no reference in the FARS about horizon just cloud clearance and visibilty
lastly the reason we have VFR mins for uncontolled airspace is becuase it is legal for an IR pilot to fly IFR in class G airspace WITHOUT even a flight plan or clearance --- dumb in most cases IMHO,...but at least he wont be contending with some fool scud running
I hope I've clarified myself a bit
PA