One fundamental concept of the MEL is that dispatch won't leave you one fault away from a Hazardous or potentially Catastrophic situation.
As others have noted, the ADIRU and SAARU back each other up - if one is failed, then the potential backup for navigation becomes the GPS.