In the UK there is no reference to minimum altitude, only the 500 feet Minimum Safe Distance (MSD) quoted in Rule 5. Some other countries do specify a minimum altitude. So as long as you comply with rule 5, you can go as low as you like. Beware other nuisance rules though.