I've the same problem with prescription sun glasses (or ordinary ones!). Gel ear seals on my headset but the problem still exists. It's exagerated because my headset is ANR, so any leak interferes with the ANR.
I find the DC Stop gaps mentioned a few times in this thread work perfectly.
Can't recommond them enough.