I may not have made it clear. I meant situation where you are not compelled to return.
Eg if your passenger received news that her mother met an accident and is in critical condition and she wish to offload herself, after you started taxy, to see her for one last time, would you return to the gate?