Try this for a cure. Wander around any GA flight line and take a long hard look at what you'll be flying.
Ask the operators of the nice shiny twins/jets etc what their minimums are. Then ask what the usual applicant has.
Wander around the car parks and ask who owns the clapped out heaps of rubbish.
Go and have a read of Deathcruzer's thread in Wannabes.
Note, most of us quite like flying. Most of us though, after a few years reckon the industry sucks. There is a difference between flying and the industry.
Also, you risk your standard of living after retirement at this age. Pensions etc are based on what you have contributed, not what you could have contributed.
If your partner is ok with it, you've done the sums and you still come out on top, go for it. Otherwise, hire a nice new single and go and have fun.