Strangely I have never had vertigo badly while flying...
But I have had hugely once or twice while scuba diving.
its always been linked to clearing my ears. Especially when I thought they are clear then I used a nose pinch instead of just flexing my jaw and you can feel the air rushing into them. The only thing to do was hang onto the shot line and wait for it to settle.