I believe that the reason we have so much trouble with insurance is that there aren't enough of us doing it. The accident rate is really low as compared to motorcycling or driving but since we are a very small group they have no interest in dealing with us. If pilots numbered in the millions or even the hundreds of thousands, they would be fighting to get our business.
Generally it is worth remembering that when we have an accident, it is fairly terminal and the world will hear of it. We can bimble along in our cars and have as many accidents as we like and still survive. How many people do you know who have never had a prang in their motor? I mean never. Not many I'll bet. The chances of having an accident in an aircraft are pretty low providing you act sensibly.