In pure statistical terms GA flying is around the motorcycle level of fatalities for time at risk. That makes it appreciably more dangerous than driving to the airfield.
Does it make it acceptable or unacceptably dangerous? All depends upon your perceptions of the risk. The posts above show how people have come to their decisions. In my case I look at young people on motorcycles and realise we have a plentiful source of organ donors
. But using similar thinking to that above I regard my flying as 'safe enough'.
Of course if you asked those young people they would say the same of their motorcycling!