Always keep an eye on your back door. If the weather is starting to close in in front of you, it is most likely closing in behind you.
My personal limits change depending on the terrain and how well I know it. The rougher it is and/or the less I know it, the higher my weather minimums are.