There might be all kinds of reasons why you shouldn't fly but what kind of parent would you rather have, one who was gloomy and, at some level, resented the limits imposed on his/her life or one who was passionate and fulfilled and could share their passion with you?
I know which I'd choose and I know that my children all remember who the pilot was the first time they flew.
No-one can make your choice for you but life is full of risk and the only way to live the kind of life where there is no danger is to live in a way in which you are not much of a role model anyway.
I think the only way in which it might be deemed selfish is if the money for flight training was depriving them. If you've got the cash then I can't see what's selfish.
It's estimated that 3000 people die in car accidents every day worldwide and about 88 in aviation accidents- perhaps you should stop driving.