I will add to SASless and Newfie's comments.
All my staff are required to complete a point based "Flight Risk Assessment", (FRaT), as I am sure are most of you.
When saying "No", wee pull out the FRaT and explain the basic concept of SMS and FRaT to our passengers. We have NEVER been questioned once we started this process.