Notwithstanding STHs excellent advice about the use of the prefix in certain circumstances, generally I would only expect to hear the pilot use PAN or Mayday on the initial transmission. I would then only use the prefix on my initial response and when I was advising the pilot of a transfer of control to another agency.
If you keep saying PAN and Mayday you're wasting words and time.
Safe flying