It's not the pressure bump you should be concerned about
It's the extra workload switching on Packs that can ( and has multiple times ) led to premature flap retractions on Airbus Aircraft during what is a critical phase of flight, especially with an Engine out......
A major Airline used to do packs off until the number of these premature Flap retractions made them reconsider the practice. Since then no more events.....
You decide.....