Despite all the ANR you can buy in a headset, it is still permitting a lot of noise through the back of the head. A helmet supresses this comfortably.
I still do not fly without the earplugs and my hearing tests are consistently adequate.
An enlightening experiment is to don the helmet and fly with the visor up for while and then note the substancial decrease of noise with the clear visor down.