If there is a control tower I expect they would nominate the direction of the orbit. If there is no control tower I would fly a wide circuit and/or extend the downwind leg rather than orbit, as I don't know the distance or speed of traffic following me.