Uber, your point is correct and the startle effect caused will only serve to exacerbate the more fundamental technical issue that Lookleft refers to.
A low speed RTO caused by engine failure or asymmetric setting of takeoff thrust causes significant yaw surprisingly quickly. It's very difficult to steer out of it while applying effective differential braking at the same time.
Having trained for both of these scenarios in the sim on a slush covered runway with medium/poor braking action I can say it's very difficult to prevent a runway excursion. Extremely valuable training, the exposure to it will hopefully stand in good stead if ever required.