Whats the problem with 500 ft ? The rule is 500 ft away not above. Therefore if you are at 500 ft on the qfe then you are not breaking any aviation rule with the exception of 1000ft rule if flying over a built up area. The CAA will not go for you - how do the muppets prove it ?