Anything worthwhile usually involves a lot of hardship and difficulty, so I wouldn't give it away just because at some point I've had doubts. A really successful career probably relies a lot more on grit, determination and self discipline, than pure love. Bit like a relationship, really....
And some of the best pilots I've ever known weren't afraid of a life without aviation.