All this advise doesn't really satisfy the consideration of the altitude at which you have to go around from a visual approach. Forget the reason for the need to do so, the fact is that you have to contend with the reality of the situation - most especially at aerodromes that are uncontrolled (i.e. where you actually have to think for yourselves and earn your money as pilot in command).
To me, it really doesn't matter whether the aerodrome is controlled or not. I will still ALWAYS brief a missed approach on the basis of my previous post. Start thinking for yourself!
If ATC is there, fine, start your go-around, tell them - though they'll obviously have seen it. If they then issue an alternative clearance, you can evaluate that against your own briefing so that you KNOW whether or not you're being given a "bum steer". The passengers are YOUR responsibility all the way to the terminal.