...there is little need to move fuel panel switches whilst in contact, but even on those rare occasions, it's not a big deal to look in momentarily to find the correct switch.
The Phantom had a rarely used switch on the front seat right console, a little toward the aft, that allowed for refueling 'internal only', no external tank fuel. Rarely used because in most cases rarely did you ever have enough fuel as it was. Amazingly, it was located right next to a switch whose purpose was controlled jettison of wing fuel tanks only. What wonderful ergonomic engineering.
Filling AAR squares one night, during the tanker rendezvous (not even in contact yet) on a track close to home anyway, I instructed my flight to "refuel internal only".
The next thing I heard was from #4....
"There they go, three."
In fairness this did allow #3 to refuel 'internal only'.