No. I've just checked with my ATPL notes, and I definitely got it right.
To quote from the Bristol notes:
Turn to your left:
Right arm downard, left arm repeatedly moved upward-backward. Speed of movement indicating rate of turn.
You're right, the marshaller's right side (as you view it) will be moving. His left side will be stationary. So you apply your left brake, i.e. turn to the left.
This would be so much easier with a picture!
FFF
-----------