Cross checking your ASI has been found to be a poor way of establishing a reliable source. What if you have two that agree but are incorrect or a strange failure like an ADIRU fault etc. what are you comparing them to and how do you determine correct indications?
All these scenarios are covered in the QRH.
Declare PAN/Mayday and fly the aircraft.