Did the Neurosurgeon give you any further details or explain his diagnosis? You can have various forms of epilepsy, some of which don't present as fitting.
I have a friend in Australasia who had childhood epilepsy, they passed a class I medical but with restrictions that he could not fly as single pilot commercial until 10 years had passed without a fit, he is now an instructor for PPL/CPL. I am not sure if he is able to fly all categories of aircraft. I think JAA will be more strict. Your best option will be to talk to an aviation doctor, they will be able to advise you over such an important matter.
Good luck.