YanYan,
I'm currently doing exactly this. It can be done as long as you are highly motivated. I am however fortunate that I don't have any kids and a supportive girlfriend.
The difficult thing for me now that i've committed myself to a commercial flying career is to keep enough enthusiasm up for the day job!
Regards,
STurns