I keep the Task Manager running and frequently find that Firefox is still running several minutes after supposedly shutting down.
Just close the process and it's gone.
I am on the Beta update update channel so it has been through several versions yet this still keeps happening.