Depends on the context.
A control surface like the rudder says no push rather correctly if your pushing on the back of it to move the aircraft. Its not designed for that.
Gently moving it to check the control surface travel however is a force it is designed for.
Pushing on a hollow aluminium wing strut on a LSA, you might bend the strut or tear the thing off.