My limit is speed-based - if I don't like what I see at 60 knots, that's the time to stop. Then you are well above any minimum IFR speeds and your stability does not reduce.
A tip I learned in Canada - if you have to turn round, find a reference, come to the hover, do a spot turn and carry on. No banking at low level!
Phil