Depending on the airspace category and how busy it is there might be separation issues. If you are under the hood with the instructor looking out you only need VFR separation whereas if you go into the clag the controller has to apply IFR separation which might not be so simple if there is a fair bit of traffic about.
For this, and other reasons, my IR instructor scheduled our flights for very early morning and late at night.