I would suggest that the flight should be continued unless one believes that the a/c has suffered from some sort of structural failure or damage requiring imediate rectification.
The fact that only 4 of the cc were doing their normal duties does NOT mean that they cannot do their main task, which is to ensure the well-being of the px in the event of an emergency; ie look out for their safety.
Continuing the flt prolongues the time to landing, giving the crew who were shaken by the experiece time to recover, enabling them to carry out their duties on decent and landing in the most proficient manner possible.
Basicly, there is no need to divert unless the safety of the a/c, px or crew are in jeopardy.