Of course does color matter as it is an extra (independent) set of information to interpret information. Imagine a cockpit with lights all colours of the rainbow and one time Yellow meant OK another Red meant OK another Blue meant OK...
Funny you should make that point.
An aircraft I fly regularly has a red up and locked light for the undercarriage, a blue flashing light (as well as varying audio tones) for the systems malfunction warning system, an orange alternator failure light and a yellow low battery voltage light on the volt/ammeter. None of those colours, or the differences between them, has any intuitive connection to the meaning or relative importance of the issue annunciated.
I think the safety of NVG operations is the 'lay down misere' answer to the reincarnation of this CVD nonsense, even if we set aside the first-hand evidence of the operational history of pilots with CVD.