You raise an interesting point which I will leave others to properly address.
I guess some of the reason has been later versions of aircraft often had bigger donks fitted.
Also transonic conditions were not easy to calculate or tunnel test in the mid 20th Century and often severely reduced directional stability when push came to shove.
The production Victor had a reduced size fin compared with the first prototype.