You know what, if you had said something along the lines of:
I can explain why there was a hold up, it's because it's actually very hard to accommodate VFR traffic in the TMA. We always do our very best but it requires a lot of co-ordination. While we can accommodate you, it is a lot easier for us if you go beneath and, if there is no pressing reason to remain high, such as icing, turbulence, mountain wave or fuel shortage, I would suggest that it is easier for all of us if you could descend.
My response would be "fair enough, I will descend below the TMA in future unless circumstances dictate that it is more prudent to ask for a clearance."
But can you not see that by saying "pay the damn route charges" and "stay the **** out of the way" you are bound to get me saying "Hey! I have a right to be there without paying charges?