I temporarily gave up flying for similar reasons. My first instructor was fine, however he left for a big jet job. The replacement was arrogant and persistently critical and after several lessons I gave up flying in despair. Six months later my wife persuaded me to have another go. I restarted with a wonderful lady instructor. We spent most of our time laughing and I eventually qualified. I now fly 70 hours year and have a great time with my flying friends.
Don't be shy. Find an instructor you get on with and enjoy the experience.
If your instructor tells you 'now let's see if you can manage this landing without a bounce'. If you both laugh then you've got the right instructor. If you feel intimidated get another.