One should not forget the statistics though. Flying above 1000ft or in IMC appears to offer virtually total protection. The risk is in low level situations which, for most people, are when taking off or landing, and during those times one's ability to look out is compromised by various factors e.g. nose up attitude during takeoff.
Enroute, the risk is negligible unless one is really crawling in the gutter. I know many pilots do fly low, but they don't have to.