Thank you to mad (Flt) Scientist for a clear explanation of the gap in my undertanding.
So if I now understand correctly, it is not applying excessive load to the rudder which is necessarily the problem. Rather it can be the secondary effect of the rudder input creating excessive yaw or sideslip at high airspeed and thus overloading the whole vertical structure.