Not only does the aircraft fly relative to the airmass, but so do your ears!
Even this is a "bad" way of expressing what is going on, but will suffice.
Turning in calm air will have exactly the same effect on your balance organs as turning in a steady 60 (or 100, or 200..) knot wind.