I think the official line is that they are supposed to be sewn on rather than be velcroed on. Haven't seen anyone do that yet though!
Probably wouldn't do you any favours if you ended up behind enemy lines...
I do think the FAA needs to raise it's profile however. I think it's a major issue, at least they're trying!