Neville, I’m not sure of the standard of FO you’re used to flying with. If you feel the need to assess the necessity of every go-around call you hear, then that tells me you are more interested in being right than doing what’s right.
As you are PIC, that is your right and prerogative.
“Go Around” is a call that isn’t issued with great regularity on an individual basis, but when it is, it is said for a reason. The merit of its utterance shouldn’t be your first priority, plenty of time to sort that out after you have safely initiated the manoeuvre. None of that diminishes your command authority..... if anything it would enhance it.
Just my opinion.