Consider these situations:
Cloud from 2000 ft to 5000 ft. Very few light aircraft flying due to the weather. You're flying outside CAS at 4500 ft following the quadrantal rule (even without a RAS).
CAVOK Sunday afternoon. You and the other 10 aircraft from your local school are practicing stalls and steep turns in the local training area which also happens to be one of the most common transit areas for pilots flying cross country.
I'm pretty sure that it has been statiscally proven that the latter results in more accidents.