Sibuk
Interestingly, I was in a very similar position to you about 15 years ago. I got my paragliding licence in the Peak District in 1989 (yes, really), and had a job as a computer programmer. I took the step to get my CPL(H) in 1992, overseas, and spent the next few years combining flying and working a "real" job.
To cut to the present day, I am now a multi-engine captain, earning over USD100K after tax, spending my nights at home with my wife, and enjoying both lifestyle and job.
The road from point A to point B has not been an easy one, far from it. Times of poverty, lost relationships, and frequent bouts of "Where did I go wrong?" depression, but now I can see the rewards and know it really was all worth it.
The only question you need to ask yourself is, "How much do I want this?". The fact that you don't know between fixed wing and rotary begs the question of desire, and you need plenty. If you go for it, go big, go hard, and draw strength from all the people (including, maybe especially, your mother) who tell you you'll never succeed, and you'll make it...one day.
Cheers
JG