While this is ultimately true it does have practical limitations. You can design an aircraft where you push the stick forward to go up and pull the stick back to go down and providing sufficient training is done everything will be ...
That would likely result in a lot of accidents in an extraordinary situation where there was a need for a quick maneuver, as no amount of training would counter the muscle memory of pilots. The brain has practically wired "pull back" as up and "push forward" as down, in everyone, any kid with a flight sim or a computer, anyone who has watched pilots on tv, or any pilot, just as the brain has wired the way your other fingers and thumb sit when pointing with your index finger. It would be practically like taking a steering wheel and making the vehicle turn left when the wheel is pulled to the right.
As for the switches, pushing them up or forward could means go, back could mean stop. I don't see the logic of I have it/I dont have it.