rudderrudderrat,
That may be because of the latency. If the visual system, the motion system and the instruments do not all respond with exactly the same latency, and in less than 120milliseconds (correct me if this figure is wrong,) the result is a sense of disorientation and sometimes motion sickness.