If it were me, I would find out, and if he was wrong, I would expect him to pay all the added expenses. It depends if you want to use that AME again. Don't cut your nose to spite your face.
I get very miffed with people that make my life difficult by making up rules.
I'm always rather perplexed by the number of threads about sunglasses. I'm equally perplexed by the amount said about colour vision/testing. Of course, most of the time colour vision might be critical is at night, when you wouldn't be wearing sunglasses anyway, so it's not too much of an issue, but it would be odd to think that many these poor souls who've failed the test might be no worse than someone decked out in their favorite shades.