Capt Claret,
A ****load of captains also do that too, the last one I slapped around the hand ignored it. Better way is to turn off the flight director and the other can do whatever they like to the MCP because it aint gonna matter! I do it all the time.
Mostmof them get freaked out without a FD though lol!