Had my PPL less than a year, am three years behind you in terms of age. Don't worry how long anything is taking, if you are ex back seat you obviously have the marbles to do it; it's just as Beags says though, the age thing goes against you, it's hard to teach and old dog new tricks. Not that we're old of course...
All worth it in the end. Went for a flight last night just for the hell of it, (rare for me, I usually go somewhere) threw it around for half an hour in the glorious sunset and came back with the 'all is well with the world' smile. Stick with it, you'll get there. Enjoy it rather than fret about it.