AP on immediately after take-off with auto land, where possible, should be considered normal. This allows PF to view the complete picture and manage the flight. Most I ever did was hand fly from 10 thousand ft or hand fly with double FMGC failure.
A more important question would be, how many sectors do you give to your F/O? And do you set conditions that make him/her feel that the sector really is PF without undue prompting? On a 5 sector day do you ever give F/O 4 sectors? Do you make F/O feel like a valuable crew member? My experience with F/O reaction was that they seldom got this consideration.
As captain, if you are mostly far removed from these principles, reconsideration is due.