In my company on the 737 we wore headsets all the time. Cockpit noise, especially with the recirc fans on, meant that taking them off made life difficult. On the Airbus however things are much more civilised. Cockpit noise less of an issue, so our SOPs allow headsets off in the cruise.
Vive le 'bus