The switch is responsible for switching off, as well as on... as you say, the system powers off in less than a second...
If you short the jumper block and remove the short, the system will not shut down until you short it again. If the switch is keeping the short in place, it will start and immediately stop.
SD