Just to clarify: The retract one step applies to the initiation of the go-around. That is when TOGA is selected and the aircraft rotated to 12.5 or 15 degrees. Therefore, on a flap full approach the flaps will be selected to 3 when the PF initiates go-around; on a flap 3 approach the flaps will be selected to flap 2 on the initiation of the go-around.
Founder,
I think you must have a copy of the FCTM which is out of date; my (company specific) electronic FCTM is dated Jan 2010. There should be a diagram of the procedure on page 10 which clearly shows the the flaps should be retracted from 3 > 1 in the acceleration phase. The actual procedure is published in the SOPs which are company specific and not necessarily included in the (electronic) FCOM.
Take it from me (11 years/7000hrs all 320 variants and TRI/TRE) that flaps 1>3 is correct.