That leaves tradition and myth. Taking your hand off the throttles just in case you succumb to a reflex action of jerking them back if you get a fright, suggests a myth.
Errr, no? Remove your hand at the call of "V1" to prevent you from retarding the thrust levers when a warning goes off. No myth, seen mistakes made in the sim. No myth, factual error management procedure.
PP