One or two of those recreational planes flying over the wilderness are pilots, who either are, or will go on to become, search and rescue pilots, and boy o boy, will the wilderness users be happy to hear a plane coming when they need one!
I have volunteered my planes for that service, and have been called upon an average of once a month for more than twenty years. Zero cost to the community, and at least three lives saved for certain during that period, as well as countless hours of ground searching saved.
My use of a local provincial wilderness park with my flying boat, is conditional upon only a landing and a takeoff (no circuits), and making my knowledge of the park's remote regions available for public safety - which could include flying searches - though I have yet to be called there. Everything involves compromise, knowing and being able to search requires aircraft and practiced overflight.
Prior to purchasing the property in 1988, where I now live with my two planes, I borrowed the loudest Cessna 185 amphibian I could, and flew back and forth up and down what would be, and is now my runway. I then drove around and introduced myself to each of the neighbours. I explained that all that noise was me, but not my "regular" plane. If they would not accept that noise, I would not buy and build. No objections then, or at any time since. The community knows that my planes are at the public service, and I have no reason to think that the planes are not entirely welcomed.
That said, I still do fly them with the greatest possible regard for minimizing noise impact on the ground.