It seems a fairly typical pattern that they break off with minimal serious corollary damage.
Apart from:
a) the America West A320 fan cowl door separation in June 2000 that caused substantial damage to the horizontal stabilizer
b) the Skyservice A320 FCD separation 3 months later that deformed the engine pylon resulting in the pins being pulled out from the EEC wiring harness connector (as well as slat and slat track damage)
Even without those precursors, a risk assessment concluding that nearly a quarter of a ton of aircraft structure in total suddenly breaking loose in flight doesn't present a potentially serious hazard would make interesting reading.