I have flown Boeing and Airbus and, I do not care if the Thrust levers move or not as long as I see the N1s and EPRs in my normal scan.
Flying a FBW aircraft, is exactly the same as a conventional aircraft. And nothing prevent the pilot to disconnect the AP ( and the Autothrust) and fly a manual approach with the FD Off, unless the Cie decides that AP, FD and A/T shall be On all the time which is not a good idea because it prevents pilots to maintain their manual skills...
When the approach is "rough" due to high winds and turbulence, I disconnect A/T and AP and fly it maually it is a lot easier, in my view, because you have a better control on speed.