Yeah, I agree with you there. Ambiguous phraseology doesn't help one bit, especially from someone who should be setting the standards. If I was in your position, I'd politely ask for clarification there and then ... "excuse me sir/madam, do you mean extend or retract flaps?"
... and isn't it not good airmanship to retract flaps on final unless you're doing a go-around?