I suspect its lack of practice to be honest, if anything I have always found it easier in manual thrust than auto. Following our take-over and integration into another airlines operation we are no longer allowed to disengage the auto thrust in normal ops. so now I am lacking practice as well, always tried to use manual thrust whenever hand flying so rather miss it to be honest.