Oakleys tend to have a very thick bit that goes behind the ear and this creates a hole under the headset where noise gets in. They are also very uncomfortable with a headset because of this.
Best to get sunglasses with very thin side bits, e.g. the Flexon frames.