The autothrust is quite slow to react to changes, it probably targeted the lower speed first by reducing power and then realised you wanted to climb so it increased power. It's a 1980s design and can't keep up with even a modern smartphone. You would have been better off waiting until the aircraft was properly established in the climb before winding the speed back or managing it.