I also find flying easier than driving, but I think it is all about attitude. I learnt to fly before i learnt to drive, and I've passed every flying test first time whereas it took 4-5 attempts for driving.
Perhaps if the attitude to learning to drive and driving in general were similar to flying there would be less road traffic accidents. Now I have my driving licence, that's it, no more tests or anyone checking up on me, I can drive as much or as little as I want. Whereas to keep my flying current, I need to do at least one hour with an instructor every 2 years.
Don't feel bad about your lack of confidence so far. Once you've visited a few airfields on your own, without the help of an instructor next to you, and you realise how easy it can be with good planning, your confidence will soon build. Sit at home and run through a PFL in your armchair. It feels silly, but it will help in the air if you've got all your checks running smoothly. If you can picture your cockpit when you close your eyes, it's half the battle.
Good luck with the remaining 1/3 of your licence.