Well no time restriction as such, though Autothrust will not be activated, and shall remain 'armed' till the thrust levers are brought back to the CLB detent (2 engine ops). This is because the CLB detent is the upper limit of the operational range of the A/T.
Safe skies