Setting the trust levers in a go-around, with the AT disconnected, is a two pilot job. PF initiates the Go Around, and FM has to adjust GA trust, as this is difficult for the PF during the pitch and configuration changes. Unless this is specificly briefed, a once-a-year go-around with two random pilots serving as a crew usually results in an interesting exercise, where at least something is forgotten, done late, or not done at all.
With the AT armed, the go-around takes less effort, as it only requires TOGA, following the FD and selecting Flap 15.
In my humble opinion, deselecting AT in approach makes life easier for many pilots.
In case there would be an inadvertent trust increase in short final, pilot still can disconnect at all times.
Main thing, as always, is understanding the system, and knowing how to use it.
Limited knowledge of SOP's only is looking for trouble, especially during unforeseen go-arounds. There is a well known low cost operator in Europe, where all go-around actions are briefed in detail before every approach.
In other places, most go-arounds become some sort of single pilot operation exercises.