DON'T GIVE UP! Stick with it, and you'll have the joy many of us do, of flying through the air with the greatest of ease, loving every minute of it.
Instructors are all different, as others have said, and the one who is good for one student is bad for another. I had some dreadful ones (and refused to fly with them again), and settled with one who was calm, relaxed, briefed before the flight and debriefed afterwards, explained what had happened versus what should have happened, and so on.
Sometimes he would say "You can do better than that. Now, what went wrong?" - and he knew and could explain it.
No coincidence that he's now flying P1 in 737s. Find the right guy, and stick with it!