Lee,
Sorry to hear about your eyesight problems. I too failed Raf selection for similar reasons (colour Blindness) and was told by the RAF doctor who obviously couldnt even be bothered to get his facts right that I could never get a PPL. Well a few years later I am lucky enough to have a job that allows me to fly just for the fun of it and I am half way towards my PPL which is restricted only in that I cant fly at night (and who wants to do that in a single engined aircraft anyway).
Go for it, best of luck and dont believe everything your told by someone in a light blue uniform.
Gareth