the only real problem is a fence or hedge-so a lawyer would have to argue whether a fence or hedge is a structure
The CAA indicated that a structure was considered to be a place where you might reasonably expect to find people, vehicles, vessels etc. So unless you are sitting on the fence that is not likely to be an issue. I believe there is a legal precedent already.