I don't think anyone is claiming it is unsafe. It gets so little use in reality (apart from a few diehards flying well equipped aircraft) that it would be hard to prove it is unsafe. I phoned around the main GA IFR airfields this morning to get a view on light GA non airways IFR in the past week (training flights removed) and did not make it to 10.....
What I object to is the wild claims that it's loss will have tin raining on our heads. Those type of claims are just red top reporting.
Whats it's loss will mean is that pilots will not have a rating that enhances pilot ability, skill and confidence. However the solution to that is for AOPA to maintain it as a certificate rather than a licence rating. The course could still be taught and pilots will have the approach and instrument experience to get out of trouble. Those who want to go serious IFR touring then have the option of doing the IR and going touring. The UK is getting ever smaller in terms of available IAP's anyway.