I'll bet the last three posters take the family out in the car without worrying.
Actually no - I don't have a car. Anyway, a better comparison would be whether you'd take your kids out on the back of your motorbike - the risks are roughly comparable i.e. an order of magnitude greater than driving. And why shouldn't I worry about driving anyway - he's more likely to die in a car accident than for any other reason.
I did take my little boy in the plane on Sunday. We taxied around the apron and he took care of the yoke entirely by himself. He didn't realise I was actually steering with the foot pedals and I suspect he might actually think we went flying - he's too short to see out of the window after all. He thought it was fantastic.
I will take him up at some point "Daddy take me in aeroplane! Take off! Fly!" but after he's big enough to see out of the window, for a start.