Pilots usually ask each other "are you available ?" before turning AP off, because it is commonly agreed that if the PF flies manual, it will increase the PM workload.
But does it really have to ?
Ahh yeah it does - if you want to fly manually, you should have the discipline to make the appropriate commands / callouts as per the FCOM, otherwise engage the AP.