My first flying lesson, which was as an RAF Cadet Pilot, was with a staggeringly experienced instructor - reputedly at the time the oldest serving pilot in the RAF. I can still hear his words from the debrief..
"You aren't a natural pilot, but then I've only ever known two natural pilots and both of them are dead."
Virtually nobody takes to flying immediately and naturally - it's not basically a natural act, strapping a machine on and using it to go flying. Some people are good enough to do a licence in minimum hours, most aren't. I took quite a few hours to even cope in the environment, and that first instructor made it quite clear that I was completely useless; I refused to believe him, and as (amongst other things) I'm now an instructor, I believe that I've proved him wrong.
What really matters is whether, and how much, you enjoy it. If you enjoy it a lot, and are likely to keep enjoying it a lot, persevere.
But as others have said, don't pay up front!
G