Safety auditors can make recommendations on pretty much anything, but it is usual for them to provide some justification. The simple fact is that it is merely a recommendation, not a finding, so your company does not have to comply with it. They can simply respond to it with "your recommendation is noted" and do nothing more.
About the only problem with this is that, especially in today's litigious society, if something untoward ever happened as the result of ignoring the recommendation, the auditors could - and would - say "we told you so". And then watch the lawsuits fly!
So, basically, if your company feels that they have a safety case that allows them to ignore the recommendation, they'll be relying on it in any resultant legal action.