Do aircrew in the Army and the RN (two organisations with longer links with aviation than the RAF) get so upset about having to take their growbags off?
Can't speak for the AAC, but in the RN growbags are only worn for flying. The rest of the time the aircrew wear the rig of the day, so apart from the size of their watch you'd have no way of telling aviators from non-aviators. Wings are not worn on woolly-pullies, jim-jams etc.