They only shout at you because you're flying and they ain't. It's perfectly understandable.
On a more serious note, just ignore them or come up with a pithy reply. There is a well known club in a flat bit of the country that has an air to ground guy of superb ill temper. I was inbound once and and gave 'G*** inbound request airfield info.' To which I got the usual garbled
'You are unintelligable', this from a guy that gives mumblers a bad name.
My immediate reply,
'Does your life have any purpose?'
'G*** say again?'
'G*** downwind to land'