I've done both pax and cargo. Flying wise no difference. As said before by others, to be gentle at the controls and to aim for smoothness and precision during flying should be in every pilot's blood.
Only thing I take advantage of is indeed the opportunity to care a little bit less about turbulence. You see those light chop conditions where you would search for a different level to give the passengers a better ride and to help the cabin crew during their service. Now, I usually keep my current level as long as the coffee stays in the cup
