As much as I wasn't going to add any more to this thread....I think you'll find that the numbers quoted are those who have waivers. There are a whole lot of pilots who don't have normal colour vision, who have been granted completely unrestricted licences.
Remember that if you can pass any one of the Ishihara, Farnsworth or Tower signal light tests (or potentially now the CAD, which passes more people than the lantern tests), you meet the standard. It is only those who can't pass any of those that are considered to be "CVD pilots", which is a far lower number than the prevalence of abnormal colour vision in the population.