LFBB,
On a go-around you should retract one stage if in landing flap i.e. 3 or FULL. With regard to conf 3 to 1 on takeoff, you would wait till speed increasing past F speed. On a go-around you will most probably be below F speed so would not want to go straight to conf 1+F.