I'd check to see if all the sockets are wired correctly. The chargers may have different amounts of tolerance for power vs neutral vs ground being in the correct places.
When it is being plugged in the ground should make contact first, but if that's not happening it may not be correctly detected by the charger. Maybe the switch is controlling the neutral side instead of the power side, so it reboots the charger in a different way than plugging it in does. The other charger may be intolerant of the original socket problems.