A theory I developed with a friend of mine who is a 737NG FO:
The cargo doors on a 737 are on the right hand side. The wear and tear reduces the smoothness of the seal, as well as possibly some of the paint work on that side of the aircraft resulting in the boundary layer becoming more turbulent over that section of the fuselage, creating the small yaw effect.
Could be wrong, don't shoot me down