If you reject for any failure other than the ones listed as mandating a RTO above 80, you will have done the wrong thing. That's it at a first glance. However, there's a catch. What failures make the aircraft "unsafe or unable to fly", as the last point on the list suggests? I'm not aware of any exhaustive list of those. Hence, it's ultimately down to PIC judgement.