If you don't close the valve the starter motor will continue to run and probably experience a RUD!
There was a time that dispatch with a U/S start valve was prohibited due to the CFM56 windmilling too slowly to restart in flight without the starter. Is this still the case? It's been a while.