Taking it back to carobert's useful suggestion, gently letting "them" know that they are detracting from the local environment beyond the norm is a good start. There are some technique changes which the pilots of some aircraft can employ to reduce the noise they produce. Some aircraft (particularly those with greater power) have propellers which the pilot can adjust in flight to reduce engine speed, and therefore the noise. A reminder to the pilot that doing so would be a good start.
As said, pilots don't set out to annoy people on the ground with noise, but it certainly can happen with carelessness in piloting. The pilot and the operators of the runway have an interest in keeping good neighbours, and will go to some effort to refine techniques of aircraft operation, and flight path to minimize their impact.
Keep your meeting proactive, non confrontational and neighbourly, and expect the same of them. Expect to leave your meeting with some commitment to a reduction in impact, even if it is just a changed route. Give them a week or two to assess the result, knowing that the odd pilot will forget.
If it is a Olympics displaced pilot, have extra patience - that sure must be frustrating for them too!