Realistically, if at one or two years there are no detectable neurological abnormalities, no fits/absences and you pass an extended sim/checkride I'd be happy for you to fly me.
Waiting another 3-4 years is most unlikely to add anything more than random noise.
Mac