Nostrinian - how about letters to respective MPs?
Granted, it may not change the price of fish overall, but it would let MPs know just what the feelings are at the coal face. I don't know what sort of majorities most MPs have with military bases in their constituencies, but I'm guessing places like Marham which have in excess of 5% of the RAF would make a dent in their majorities and send a message if it didn't actually get their opponents elected.
Given that the electoral map is already skewed in Labour's favour, the prospect of losing some of their traditional seats might just be enough to make them realise what they are setting in train. After all, they clearly don't give a damn about us, but the prospect of losing their own livelihoods might just make them think again.