Ah! that's the way I prefer indeed, and have done it quite a few times, but in most airlines they want you to use automation.
It greatly depends on the captain. Some get scared if I disconnect, others (fewer and fewer) encourage disconnection. Lately they are restricting more and more hand flying, sadly