Strangely take comfort from the accident statistics.
Controlled flight into terrain remains one of the biggest killers, as does loss of control in IMC.
Poor weather planning is up there, and so is poor maintenance.
Lack of currency is a factor.
So if you remain current, ensure the aircraft is well maintained, avoid IMC unless instrument rated and dont take liberties with the weather you have probably eliminated 80% or more of all accidents.
There are a few accidents which are almost unavoidable, but I bet you can count these on one hand over a very long period of time.