I don’t see any valuable reasons to rush the hand back on the thrust levers just after v1. It takes a fraction of second to put it back in the very unlikely you need to use them. As mentionned many times before, the startle effect is too dangerous, so I keep my hand well rested on my leg usually until gears are up.
When you are driving your car, you don’t put your foot exactly on top of the brake pedal so why would you put your hands on the levers...