The main problem is that the screen on certain radios and GPS displays are also polarised. If it just happens that they are polarised the opposite way to your glasses, you will not see anything displayed on the screen unless you rotate your head through 90 degrees. In airlines with glass cockpit, the whole instrument panel is a polarised screen so not being able to see this would be a big concern
So if you fly some microlight or old school aircraft with old radios, or no radio at all, you'll probably be fine.
If you intend to use GPS, or any radio nav aids there's a chance you'll have a problem.
Also the psycedelic rainbow colours as mentioned above. It's what I'd imagine being on LSD is like
