It was my understanding that pilots were essentially exempt from rule 5 (ie 500ft) when on climb out and approach as long as any published approach information and guidance is being followed. Nobody wants to come down on anyone's house and despite the best intentions of the pilot it is not always possible to comply with this rule in reality.