To let him do the mistake or removing him from the control is not an option. This will only exaggerate the situation.
I think you should talk to your FO on the ground, first explain to him that this is not a criticism on his flying, but inform him that you are a team, and that you as captain don’t feel comfortable or safe with this behavior. If he does not realize the problem, you have to take this higher, talk to the chief pilot.