I don’t doubt that if you went somewhere similar in Northern England and said much the same about certain minorities/ethnic origins, that you wouldn’t get a similar reaction.
Incidently, I’d have been tempted to break the habit of a lifetime in the above situation and remind them of the war. Then again, discretion is always the better part of valour.