I reckon flutter is related more to TAS (the actual airflow velocity) than IAS, but the ASI has to be marked in IAS.
This is why, AIUI, when some aircraft types are modified with a more powerful engine which enables them to climb higher (where the TAS gain over IAS is greater) the Vne figure is reduced.