Almost everyone I know who is a 'fitness' fanatic does themselves serious damage at some point. I have known two people who - literally - killed themselves by pushint themselves too hard in exercise regimes. Our bodies are designed with certain limitations beyond which we should not keep pushing them.
Walking to the pub and lifting a pint of beer would seem to be a reasonable limit on a daily basis.