Gee SA, I knew a bloke in almost exactly the same position as you are (minus the vision issues). He got into flying without the same passion or healthy respect for the issues around flying though. Sadly, his career ended at a little known place called Clyde.
Anyway, you go for it! Not many of us have the means to get a second chance & follow our dreams. You could probably invest the money & end up coveting the interest, or you can grab an opportunity you had thought lost to you & get in amongst it!
Go get 'em tiger!