Excuse me for butting in from the pilots forums. On the basis of what you have written it would seem to have been a bit of a misunderstanding between both of you and it takes two to tango. However it is really the pilots responsibility to make sure that he has clearance to carry out a particular action. If in doubt ask, it also goes to show the importance of standard RT even in a VFR environment. I know it's not easy when you are not that experienced but if you had said something along the lines of "overhead xyz and request zone entry for landing on runway xx" you may have avoided the situation.
You don't mention what happened once you were on the ground but I think you will find that a phone call or even better a quick visit will smooth over most situations without it going any further.
Good luck.