Hey man. From your earnings I would presume you are of senior officer grade (?). I also spent a bit of time in the gov and was on track to make a good income that people my page could hardly have. I understand how hard of a decision that was. But I was young and lucky enough to not have the burden that you have, and I got into the programme not long ago. Back-up plan is not doubt something you should consider. I would suggest if you were to go for it, make sure you have the financial reserve to cover your liabilities in the coming few years. And more importantly to have your family support. It is a risky and long commitment (for 6 yrs) for people with dependables.
Have you considered moving to Canada and do some recreational flying there?