Also take a look at the plan area of the tail fin, it's huge! As Rainboe has already said it's a stubby beast with a massive fin, add in a x-wind and you're going to need a pretty hefty rudder swing to counter act the sideways wind forces from the fin.
I was behind the beasty into LHR last year and watched the video later, that was a blustery day when we were all stirring to controls a bit and the landing look perfectly normal to me.
The rudder in the 320 is the only control that is directly linked to the cockpit (cables), however in normal flight laws it is still actuated by the flight control computers it only reverts to manual if there is a serious fly by wire failure.