After you feel that your airplane is well trimmed. In my opinion it is not when you are "allowed" but when is it "convenient" All is about priority. If you have a mistrimmed stabilizer in excessive nose down position, you may need your both hands to pull the control column. I think once you feel comfortable you can put back your hand on thrust levers...although some super instructors have a strict rule about it.