I recall a story that the pilots only wore the inner helmet as this allowed them an extra inch headroom which aided the restricted view when landing.
No doubt an ex Vulcan driver will put me right .
I also believe that the first Britannia crews had to wear the cloth helmets as the powers that be decided they did not require commercial headsets to operate the aircraft but should wear existing military issue earphones and intercom built into the cloth helmet.