Get a bike - and with proper training you're no more likely to dead yourself than in an aeroplane (I'm assuming some exaggeration in your descriptions of your flights 'else I'd say biking is FAR safer!).
And bikes are cheap to buy and run. So you can still afford to fly!
I was introduced to biking by fellow pilots, the more adventurous (and skilled) of whom were bikers as well as aviators. Probably not many magenta line followers are bikers!