However, my flying might result in an innocent being injured or worse. That applies to all forms of transport, so do we ban everything?
When you fly your aeroplane, the risk to passers by is mitigated somewhat by the 500 foot and land clear rules.
CG (no bans please, just common sense)