If they allowed you to take the signal light gun test then you would be able to show that you could operate safely.
In the US this kind of waiver has been issued for many many years and not one single accident/incident has ever been attributed to a pilot with one of these waivers confusing colours. (according to the NTSB database)
A perfect record is hard to argue against.