I was once persuaded by my boss to come back from Beauvais VFR (to save a 3-hour slot delay) and we did most of it at 240 knots. I swore that I would never do it again. It was not smart.
Yes I think some have believed that we fly around outside CAS without positive radar control, that is asking for trouble at high speed.