What I learned when I came to the 320 (after six years in other jets) is that the whole key to hand-flying an Airbus is "less is more". So, whatever input you were planning to do with the sidestick, reduce it by half. Make small corrections using your wrist, not your whole arm. Don't give it any more muscle than you would a computer mouse.
Same with the thrust levers. Move them a little at a time, don't give or take thrust by the handful. You'll get the hang of it.