That's correct. V1 is the point by which, if you are going to stop, the first actions should have been taken. i.e. call 'Stop!', close the throttles and start to apply the brakes.
The calculations assume an engine failure at a speed called VEF two seconds before V1, the theory being that it takes up to 2 seconds to recognise the failure and start to act.