I suspect the hand/eye test is designed that way intentonally to see if you can adapt.
After reading the instructions I also was worried about the reverse behaviour of the ball but just had to re-program my brain. The (extensive!) practice you're allowed really helped me with this.
Were you also updating the autopilot panel on the multi-tasking test? The red-square-cancelling was described as a "secondary task, but equally important"