Seems obvious to me that the speed instruction is only an INSTRUCTION to the extent that it does not compromise flight safety or aircraft limitations ... if you cannot (or can no longer) comply then say so. ASAP.
If you restate any imposed constraints to every new agency/frequency then sooner or later one of them is going to say it no longer applies. If not cancelled, then when you have to slow down - say so, then do it.