Ok a serious response, he is being an arse but you should avoid escalating the problem. Speak reasonably and point out the things listed above, such as: he is changing the rules arbitrarily; he is going to increase costs and inconvenience to both of you and, if things get realy awkward, neither of you will come out with much.
Have you set out your arguments in writing to him? If not do so soon. Do it reasonably and in a friendly fashion. Use some of the more sensible arguments from this forum if it helps. Remind him of why you did this in the firts place. Surely the biggest motive was convenience. Above all make sure that niether of you tries to "win". Neither of you will.
I have spent a great deal of my time in arbitration and in court and no one ever really wins except the lawyers if things get out of hand.