I write with my left hand and till now I have never flown with my right hand.
CZV, in practice you are not really flying the aircraft - you are controlling it remotely. The FBW control tilts for pitch and roll - once the required attitude is attained, let go of your pressure on the stick. If you continue to put pressure on it then you would continue to increase the pitch/roll angle.
Being left- or right-handed therefore does not come into it. Control the stick with a light touch and cross scan to the AH for confirmation if you are hand flying. I have not flown an actual A320 but have undergone training in an A320 6-axis full-motion simulator at Airbus China.