Not a prayer.
At 500 metres you would get group objections from the town.
500 metres would be well inside a suitable noise buffer zone
You would lose quite a large sector on takeoff because you can't make safe height over the town.
But the killer punch is the Rural Living Zoning
Rural Living is where the town's lawyers and doctors build their McMansions, and they've got money to fight noisy hobbies
You have to go out past that fringe - maybe 10 mins or so out, then talk to all neighbours within a km or so radius. If they all agree, there's a good chance.