Its not a case of whether it was serious enough.
The crew will be balancing a wide range of potential risks, the risk of second failure or loss of power over built up area are just two of a great many. This crew decided (rightly in my view) that the best balance of ALL the potential risks lay in returning to LHR. One aspect or issue rarely dictates the entire process.
Hope that helps.