If you cancel IFR in Class G (you don't have to request), the controller will not be too bothered, it'll probably make life a bit easier for both of you. If you are on an advisory route (class F) it might be a bit more awkward; the controller may have issued releases and clearances to ensure separation against other participating IFR traffic.