Adding TOGA once you are stabilized is not much more difficult than adding power on a single engine approach: you just have to add a bit more rudder. However, your climb performance will increase dramatically, and as someone mentioned, the aircaft is easier to handle with the extra thrust (A320).. So, just af the FCOM says!
Just make sure you are stabilized from the initial wobbles.