davidjohnson, it will always remain the captains decision and the cabin crews action to close the forward entry of the aircraft.
If they are really able to finish the boarding process with all the associated paperwork 20 minutes early (lucky them!) they are free to go.
Any delays thereafter can have various reasons (slot, finishing checks or briefings) - and are totally random.
FA10