Sometimes the velcro stays in place and the flap itself blows out at once. It will definitely get your attention if it happens in cruise.
So take a look, if they are showing wear you might avoid that uncomfortable "WTF was that" moment in the cockpit.