thing, based only on your post and on the understanding that you were correctly observing the club procedures I'd opine that you would have been in the right to reply stating that you were clear of the runway and not move. Without knowing the field in question I'd even go as far as to say that if it was a 'non radio' field with safety com being used you'd have been perfectly entitled to keep quite, stay put and let the other guy decide what to do.
That all said getting yourself further away from someone who might not be as on the ball as yourself sounds like a good 'self preservation' move. Just because someone else isn't up to scratch and is being stupid doesn't mean you have to play his game.