Bowie,
If an IFR clearance is not immediately available, an aircraft can depart VFR and climb up to the base of Class A, before picking up their IFR clearance. All in Class E!
Did it ever occur to think WHY you couldn't get a clearance? If so, did you do anything about it or just blast off into the ether hoping you didn't run into anybody?