If in doubt, (and time allows) I would ask the opinion of the No. 1 Cabin member (and as many of the crew as possible). Same as if you suspect the pilot might be under the effects of alcohol. If time does not allow, you would do whatever you need to do to ensure the safety of the flight.