If you watch the rudder trim value while accelerating after v1 cut (still manually flying) you will see the rudder trim value reduce as you accelerate which I deduce is the Rudder Travel Limiter doing its job as the IAS increases. I believe that is the only time the rudder trim will move uncommanded while manually flying - unless someone knows different!!
Cheers,
mcdhu