However if you are flying through class E airspace and ATC say No Speed Restriction, then the 250 below 100 STILL APPLIES.
I think you need some distinct phraseology for when it means "no speed restriction and I authorise you to go faster than 250 kt" and when it means "no speed restriction apart from the 250 kt one which I can't lift".
And in fact I think you need to take care of this for the pilots within controlled airspace. The construction of CTRs/CTAs is often quite complex, and it's almost impossible when being vectored off a planned route to keep track of the airspace class the aircraft is passing through.
I'm
not suggesting that this is an excuse for the pilots not knowing the rules.
Now all I want is an aircraft that does more than 250 kt.