Occasionally there are going to be differences of opinion like this but some controllers are just too ready to give out a tongue lashing on the radio. It is a flight safety issue - a pilot will be distracted for some time afterwards and if nothing else, his lookout is likely to suffer.
I suggest this is investigated properly, I would certainly request it if I felt I was being wrongly accused of an airspace infringement.