Just as I find it worrying that military controllers might be crossing UARs without realising that civil traffic might climb or descend.
When it gets down to it we are not providing a radar advisory service in the upper air. I'm sure no one would deliberately put his traffic into conflict with a military contact just to prove a point but we cannot be expected to spot every 'unknown' military aircraft.