Rudder is used in conjunction with aileron to prevent adverse yaw. Thus, when deflecting the aileron you have to deflect the rudder to stay coordinated.
To me, it sounds like your roll-out is uncoordinated. I don't know your level of experience though, perhaps higher than mine.