If it's just the medical you're going for don't worry about driving. You can get to the CAA easily from both LHR and LGW on public transport - there's a buss that goes to the CAA's front door.
Beyond that, having had drops for eye checks I would suggest that 3 to 4 hrs is a more practical period to wait......but I guess everyone is different.