Pulling the thrust levers all the way to idle is one of the ways to disconnect the autothrust. But even with autothrust off, when certain (quite high) value of AoA is reached, autothrust will command TOGA power regardless of the position of the thrust levers. Airbus calls it alpha floor.