My worry was that I wouldn't be able to concentrate on my career properly if I was thinking about flying and the PPL exams all the time.
I think it depends possibly on what stage of your career you are at. I admit, I do eat, sleep and breathe flying and studying...and having to fit it in around work is tougher than full time study at University!
I'm always hiding in a quiet corner in our library at lunchtime and my colleagues know that i'm not to be disturbed.
However, I took up flying now because its a lifetime ambition to be a pilot and i'm settled in my career, have been doing it long enough now so needed a new challenge and something to really make my brain work. You know when the time is right to do something and if its the right time for flying for you now, go for it!