I currently fly the A320, but have 6 years previously on conventional types.
The side stick works very well, I too hit the stops in roll in rough conditions but you must be aware that it commands 'rate of roll'. So even at the stops its commanding max rate, the aircraft is still continueing to bank over at its greatest rate.
In pitch its commanding 'g loading', its very natural to fly depsite the sceptics.
I like most had mix feelings converting onto it, the one thing I do miss is the control force feel and trimming. The auto throttles you get used to, but you can still fly manual thrust with a very good speed trend vector.