What's the point in routinely hand flying from TOD? Maybe occasionally I can understand. The AP is there for a reason to take the workload off the pilot so he can concentrate on things like situational awareness etc. For sure as White Knight says, you will load up the PNF, especially if it's a busy TMA with plenty of ATC frequency changes, crap weather etc and achieve very little in the process.
Hand flying SIDs every now and then is good for instrument flying. I do this mainly with the FD. Also hand flying approaches from before glide slope intercept fairly frequently is definitely recommended. Again I mainly use the FD but in reasonable conditions would be happy to go raw data. IMHO this type of low level handling is far more beneficial than hand flying from TOD!