Well I'm not under the illusions that flying a light aircraft is safe. However from reading the accident reports in the usual flying mags, it would seem that the majority of accidents are easily avoidable.
If you take the propper steps and don't get lazy or over confident, the risks shouldn't be too high.
At least that's what I tell myself everytime I find myself rushed going flying. Force myself to slow down, and make sure I avoid all the silly mistakes that I can.
dp