You're supporting the Labour party, whether you vote for them or not.
When I were lad you had the right to opt out of paying the political levy to your union.
You may still be able to do so; if interested, check.
As a 15yo apprentice, I opted out, much to the disgust of the shop steward
