Don't worry about it mate. Every kind of spotter usually experiences the same thing. Ignorance is usually the reason, people who haven't got the ability to develop an interest in anything are generally leading dull lives and resent other peoples interests.
Whilst I don't spot on a regular basis, a day out at Manchester with my grandson is a delight to us both. When I was a frequent business flyer I would always book an airport hotel with a view of the runway, if i had to stay at the airport. I would arrive early for my flight so i could watch aircraft, long connection times when changing planes was never a bother to me..
Their is so much to see and do at an airport...