Hi misd-agin,
I believe the tactile feedback from moving throttles is important. The requires two steps - 1. moving throttles and 2. having your hand on the throttle levers.
I agree with the above when Auto Thrust is engaged.
During Take Off & GA Auto Thrust is not engaged.
During a GA, either auto thrust should be designed to disengage automatically or pilot's trained to disengage it.