Teaching people to fly is as much about teaching decision making and confidence in the aviation environment as it is about teaching the mechanical skills of controlling the aircraft.
Clearly the instructor is not communicating these "soft" skills in positive way for you, perhaps you need to look as yourself and ask if you are being over sensitive to his critical observations and comments, only then can you decide if it is time to change instructor.