There is no need to hurry to switch anything on or off in a modern airliner.
It might feel Mickey Mouse to some, but
-decide what you need to do,
-identify the correct panel,
-identify the correct switch,
-confirm with the other pilot if the switch is guarded or if whatever it is cannot be switched back on in flight (e.g. an IRS)
-operate the switch.
Doing all that will take about 3-5 seconds, rather than about 1 second to stab at the wrong switch. Accuracy and operating the correct control is the overriding consideration.
I have been known to turn the speed knob instead of the heading knob (doh), so I now try to slow down and be more methodical - speed of operation is secondary.