A damaged or missing radom obviously can cause a huge airflow disturbance aft of the nose, the pitots, alpha and beta vanes would be severely affected by this as well... I think the effect on the control surfaces would be a much smaller problem than the loss of reliable air data.