In my humble opinion I think that it is the position of the switch and the type of switch that is the problem. A toggle switch (regardless of its stiffness within reason) on the end of the collective is just too easy to inadvertently operate when the pilot moves his hand from the collective to somewhere else. Considering that unless it malfunctions the governor will be switched on at the beginning of the flight and not switched off until you have landed I can't understand why it isn’t a guarded switch.
Not a dig at what you said Cran just my opinion:
I think that fitting a stiffer switch is a very poor solution to this issue.
Maybe just maybe if it is switched off, or fails in flight there should be an audible warning that you could cancel if you wanted, or had to continue the flight without it on. Just a thought.