According to my knowledge the "Thrust set" call should be made when N1 at T/O thrust is -0% to +2.5%.
Another important issue regarding setting thrust is that if you're on a slippery rwy and hit the TOGA switch before N1 is at least 40% or if the T-levers move upp unequally you will if you're unlucky veer of the rwy.