I'm 27 and after 8 years in construction am thinking of making the career change. I don't think there's a particular time when you should do it, thats entirely dependant on your personal circumstances, it's more do with with trying to coincide your training with any potential upturn in hiring for low houred pilots.
Personally I'm taking some higher education part time to act as a backup and potential buffer where I can return to work if needs be and I think you are wise in studying to act as the same buffer if you should need it
I didn't go to uni, so someone better informed than me will tell you but If theres opportunities to get involved with the UAS or similar it would be worth giving it a go to differentiate yourself from mr joe bloggs.
Good luck with what you decide.