I think the right question would be "when do you loose the ability to fly your aircraft with an acceptable degree of safety?"
A standard flight could be managed by many even after quite an extended period of not flying. But could they still handle an in-flight engine failure? Sudden and unforecast inclement weather?