Idunno, you are actually correct in what you think.
If you are following the Boeing published procedures, then what you basically have are "areas of responsibility" with regards to the PF and PNF. Basically what you touch and what the other person touches. The throttle quadrant is the PF's area so, when thrust levers are advanced, PF would take his hands off and at the same time say 'set thrust' to the PNF, then PNF will have his hands there and say 'thrust set' and then hand the levers back to the PF. Well, that's just Boeing's way and I know not all airlines do that because everyone has and refines their own particular SOP. There is really no right or wrong, just different SOP.
Actually I've done it both ways, and even though you have your hands on the thrust levers and 'follow through' when thrust is advanced, you don't have to put your hands right at the base f the levers. If you follow up closer to the top (and it' easier to fine tune and set thrust at that position too) then the potential for any harm to yourself in case of an abort is minimal.