Maybe one can rationalise it.
I hate being up on a ladder - even 2m high. But flying has never been an issue.
Once I flew with a friend who got anxious when we did a turn. He thought that if you tip the plane to one side, it will slide down, sideways. So I showed him that this doesn't happen (the centrifugal force balances the pull of gravity) and he was fine after that.