Its not just the likelihood of damage but the scope of damage if it does occur that is of interest when it comes to decide - pull harder or let airspeed go higher.
djpil
I would say the main concern is damage to oneself by doing anything which makes the aircraft unflyable. Anything else which doesnt make the aircraft unflyable is expendable.
It all depends on how much airspace you have to play with as well as the quality of the air you are diving through
Beyond VNE may be ok in smooth air but if you are beyonding VNE with a solid deck of cumulus fast approaching NOT GOOD

Infact that might not be good sub VNE!!!
Undercarriage, airbrakes,overspeeding props is better than NO wings or tail.
Flying jets and it is quite common to descend high level near VNE and easy to exceed.
Low level its very easy to overspeed in level flight never mind descending.
Pace