Part of the problem is that people do not fully appreciate the risks of GA. It is not as safe as airline flying, and final approaches can rapidly change from thinking about whether to get a coffee on the way home to near disaster.
There is no pause button in flying, and I think that there is actually a fair amount of complacency amongst certain individuals, but they'd probably say I was too cautious!