The guy on the phone rudely claimed that 'It was the military and they make the rules' after questioning the reasons
"Claimed"? I suspect you mean "informed you". FWIW, the military do make their own rules - not all of them make sense, but most of them focus on the big picture rather than the individual. If that's not something that you're happy accepting, then now is probably a good time to nip that possibility in the bud.
OTOH, marginal Class 1 eyesight shouldn't bar you from getting a PPL, IR, etc and flying in your spare time - often a better solution for people who can make a life in another industry and then afford to fly as a hobby.