There is also the issue of headset heat.
You wear a close fitting headset which means there will be heat trapped in the ear canal. You sweat, it can't evaporate, your ear fills up. Simple.
Yes that is very noticable after a long cross country which is why I purchased these:
http://www.flightstore.co.uk/black_c...163.dept_l3.0/