How far out, no rule just - 500' from any person place or thing (or vessel)3.
I once skipped down the coast at 500' for a few minutes. Having been used to 2500' for so long it seemed quick. I quickly recovered to a more sensible height when I thought about my engine out options.