As far as I can see, if FEP starts failing, the pilot just continues steering from the sidestick. S/he just needs to be aware that if you make bad choices for inputs they could damage the aircraft. Is this not right?
Yes, that is correct, and the cautions are in the AOM and QRH. Handling the aircraft is completely conventional in Direct Law.