"Any man", said Dr. Johnson, "thinks more meanly of himself for not having borne arms for his country".
(It seems that this quotation should correctly end: "for not being a soldier", but this is the form as I first heard it, and I prefer it).
There may be an element of this (envy?) involved.
D.