The pilot may not have been unsure of where to land, instead, was probably assessing the area/approach for possibe hazards. Normally aircraft like to land into wind which allows for an easier and more stable approach and your house may have indeed been downwind of the landing area.
Even so, I feel the pilot needs to know the disruption his approach has caused. Maybe you could keep trying the hotel? Surely they can't be so unfriendly?!