Sorry to hear about your troubles. A student/instructor relationship is a very close one, and it's important you get it right. I've never been this unlucky, but another lass in my club has, and she told her instructor to f**k off after one lesson. Not the most diplomatic way of handling it, but she got her point across

Now she flies with my instructor, and is making rapid progress.
As has been said, you are spending £100 an hour to do this. Ask yourself why. Is it because you enjoy flying? Well you're not doing so flying with this guy! So he's getting things through to you? So what! Take longer with someone else and enjoy the time. It's not a race!