It's the effect of the horizontal stabilisers as you are changine the air flow across them and probably changing how much the main rotor downwash impinges on them.
You should also see roll in the same direction as the yaw as it is a secondary effect. If you are masking this inadvertently with cyclic, you may well be applying some small fore and aft cyclic as well without realising it.