You only have one elevator left so you might not have enough pitch authority left to counteract the pitch moment created by the autothrust. When in manual thrust this pitch moment is more easily controlled/mitigated.
The gear extension also creates a pitching moment which at low speed is harder to counteract due to the reduced pitch authority.
Hope this helps