The bottom line is that if you do not annoy the local community you will probably be ok.
This has a lot to do with where you are. I operate a strip in rural Dorset where we operate on a live and let live system - I don't complain about the occasional smells, slow tractors, packs of wild men in red coats etc, my neighbours don't complain about the occasional aircraft.
These rules do not seem to apply in Berkshire/Surrey. It only takes one banker to start kicking up a row to attract unwelcome attention from offialdom.
Keep a low profile. When you fly from your strip just go away, don't go for pleasure flights/circuits near home. Don't leave your turboguzzler parked where people can see it from the road.