Maybe you would be encouraged to learn that I completed modular CPL/IR/ME whilst working full time - aged 44. It took three years in total from when I started the ATPL distance-learning written exams.
I don't have a full-time flying job but I do get a lot of free or paid flying related to my job (I work in the super yacht industry in the Med and so get to deliver crew or spare parts around the Mediterranean islands).