I too have had this issue, and I completely understand your frustration, Plasmech. I
did change instructors! - although he wasn't the CFI. (How the hell did your guy get to be CFI?
)
There is a deliberate protocol set up for this - the "you have control/I have control" dialogue, which is designed purely to establish which
one person is in control.
Not sure talking to your instructor will do any good - it sounds like he does this sort of thing out of habit.
Good luck!