I remember an instructor I had who quite frankly was Crap. I wish I knew then what I knew now. I would have dropped him like a stone. That is my advice to you. Don’t waste time with him. If you are unhappy then tell him you no longer want to fly with him and ask the other guy to teach you. If he doesn’t like it tough.
This is a business and you are the customer and if they can’t be bothered treating you as such then take you money elsewhere. There is a terrible attitude in the aviation teaching establishment that this is just the way it is. I don’t accept that and suggest you don’t either.
At the end of the day you are paying for a service which quite frankly your life may depend on. If it is not first class then find some that is.
Good luck.