Pontius,
OP mentioned the case A/P and A/T off, pretty sure that in that case, pushing the TOGA buttons will not advance the thrustlevers( unlike the 747)!!!
My edit was because I stated that for both manual and autoflight Boeing says to manually advance the thrustlevers. Reviewing my old manual I found that statement to be incorrect. In autoflight Boeing does not mention to advance the TL manually. So I deleted that sentence. You may say ignore my post.....be my guest.. By all means