All piloted aircraft are designed for the failure mode to hand it to the pilot, my words.
You are simply stating current design philosophy - you are not describing a fundamental limitation of automation.
There are good arguments against autonomous flight but that is not one of them. Every failure mode could ultimately be automated. In each case a fair sized mountain of a safety case would need to be addressed, but it could be done. The big question - is it "worth the candle".