The problem is that freedom is not an absolute thing. If it is not defended, it is gone in shortest time.
And what else is defending freedom but restricting it - in this case the freedom of its enemies to combat it?
Here is a paradoxon that ought to be solved by Western civilisations rather yesterday than tomorrow.