Flap 3 to 1 is correct if you have flown a flap full approach. If you have flown a flap 3 approach you would have selected flap 2 on initiation of the go around (up 1 stage).
It is written in my copy of the FCTM on page AO-020 14/16 (OEI Go Around) where it refers you to pages AO-020 7 - 10/16 (ENGINE FAILURE AFTER V1). You will see it on the diagram on page 10.
However, you do have to think a bit. There may be a speed restriction in the GA procedure involving turns below S speed to avoid terrain in which case it would be appropriate to select flap 2 until after the speed restriction.
HTH,
WS