You say one passenger fatality in 5000 missions is high. And yet we accept (in 2016) approximately 1235 people killed in fatalities on Australian roads.
Problem is that the motor car would be 1235 fatalities in circa Billion+ 'missions' so a minuscule fatality ratio in comparison.
One of the things dragging all forms of GA down is the lack of technology upgrade of aircraft and lack of training facilities. If you look at the USA you can get a sim for basically any type of aircraft which really enhances the training available, and vastly improves your IFR skill set.