Not a pilot or aircraft engineer but I am assuming the Captain went back to look at this mess and he must have been pretty startled at what he saw and even more startled by what he couldnt see but knew might have happened.
All sorts of nasty things could happen under the wing, and out of sight, that didn't trigger ECAM messages. I would think that the air resistance/drag would put immense stress on an already overstressed pylon with the risk the whole thing coming adrift at 500kts and doing god knows what damage -over Greenland too.
On the recovery side I think AF didnt do a bad job for the pax, after all if you were in AF Ops and someone said whats the worst possible non fatal injury situation we could face, I think a 380 emergency diversion to a remote Canada field would be high up the list