.. keeping in mind, of course, that the label on the CB may not indicate ALL the services which take power from that circuit ie you don't necessarily KNOW what may have a problem ... you just might give yourself an unwanted surprise by playing with the panel.
It gets worse as the electrical/electronic complexity of the aircraft increases ...
Perhaps best to follow the published operational guidance as a general rule ?