If you are flying on one engine*, I think you should be looking ahead and at the PFD, and instruments, not looking down at the rudder trim control. Get the aircraft under control, (and centre the beta target), and then trim out any rudder control forces by feel.
The rudder trim does move very slowly though, about 15 secs for an EFATO situation.
*perhaps you are flying a desk top flight simulator, in which case it might be tricky to judge, hence your question?