Being thoughtful about how you fly is not just about those on the ground. As a single engine helicopter pilot while I do my best to avoid disturbing those on the ground I am more concerned about myself. If I have engine failure where would I rather come down - built up area, lake, forest or nice clear area. With no glide to speak of I tend to skirt around the outside of these with the added benefit of keeping me away from NIMBYs and such like.