But what if you found yourself in this situation?
8 January 1989; British Midland Airways 737-400; near East Midlands Airport, UK: A fan blade failure at top of climb damaged one engine and the crew mistakenly performed a precautionary engine shutdown on the wrong engine. The damaged engine lost power shortly before landing and the flight crew was unable to restart the good engine prior to striking the ground. 47 of the 118 passengers were killed.
If you had pulled the fire handle on the wrong engine, there would be no reason NOT to restart it!