Can't say I've noticed it, but maybe because most of the people who don't use a headset have the speaker turned up to 11, and so I can usually hear ATC clearly enough from the opposite side speaker, with my headset on. That should tell you how "quiet" the cockpit is.