I cannot see that pushing/pulling a normal light single by the prop by hand can possibly do any damage. The internal prop components are massive. At max rated rpm, the stress on the prop blades is around 1/4 of the yield strength of the blade root...
But I wouldn't push/pull on the tip; there is no point, and one could possibly bend the tip if one tried really hard.