I remember getting the leans flying a DA42 back from the Miramar airshow at night. It was cloudy, dark, bumpy and raining. And it was quite bad. But trusting the instruments and it was not really an issue, just an observation. You also might get it worse if you have a slight cold or something going on with your ears.