For what it's worth, the RAF C130 fleet leave it until above 1000' on take off and take it out in the Landing checks. However I'm sure the system is different since the props are electrically synched and a power loss on the selected master prop would be transmitted to the other 3. Therefore it is selected off/out for safety.
Safety always should come first. Unless the noise is unbearable for passengers, I don't think the distraction of operating engine levers in what could be a busy phase in the flight is worth it. Leave it until safe to do so, especially for single pilot operation.