Can't say I would deny or get stressed about a little local flying. After all, a thundering great Hercules stormed over the house at low height this morning, filled up half the window (erm, optically). When I first moved here there was lots of traffic (aircraft and ground) so it's all much quieter now, hence no reason to get excited about small things.
PalmerSport - Your venue - Bedford Aerodrome
Apparently the strip of land from the Wind Tunnel site to the main site, and presumably the airfield itself, is a designated 'white zone' wrt planning. This is a form of reserved status which reduces local authority control.