Well, let me hazard a less than perfect opinion.
Could it be that when you are hovering downwind, you are using more left pedal (or right if it's French) to hold the machine steady? I seem to recall (it's been a few years) that the chopper always wanted to swing around into the wind and you had to fight to keep it facing downwind.