On the bus, Company SOP and Airbus' recommendations are FDs off while hand flying. Constantly setting targets in the FCU (MCP) would miss the point of hand flying. Furthermore if you want to reengage the AP doing this with the FD off will give you the values (HDG, V/S) according to your current flightpath.
I will take a visual approach if I can get one, and if not busy environment will then usually hand fly from ~ 5000ft.
Whether or not the aircraft is FBW misses the point. Hand flying the bus is a joy, don't think many bus drivers miss the trimming.