The AP is there for a reason to take the workload off the pilot so he can concentrate on things like situational awareness etc.
There is nothing like hand flying to promote situational awareness. It's letting "George" fly it that can actually cause loss of awareness.