At 35 I had had a PPL for quite a while. Even though I couldn't afford it all, I decided to train for my tickets because I didn't want to get to 40 and regret not trying. I did it modular whilst retaining a full time job, most of the time. I do have some loans as a result.
However I did it knowing that it could all come to nothing. Accepting that I have NO regrets whatsoever no matter what the outcome is. I'm (hopefully) a better pilot. And I know I tried my absolute hardest to get there. Nothing ventured, nothing gained, and I'd rather try and fail than not try at all. The cost, to me, was worth it.
I have done some part time flight instruction recently, and have just landed my first full time flying position (not as an instructor). It was not easy and I made a lot of sacrifices, but so far nothing I have regretted. BTW I couldn't afford to work full time as an instructor, otherwise I would have done. The job I have now is double instructor's pay.