For me, the main problem was weather. While getting the PPL, having an instructor there to tell you what to do, it all seems quite straight forward.
But then you end up with a plane and have to make your own mind up about where you're going to go. At first this is fine, but then the local trips become boring and you think about longer trips away.
And now the weather becomes a real pain. I've had several weekends away booked, all of which have been cancelled because either the weather was bad to start with, or the forecast wasn't good enough to risk being away from home.
Add to this quite a few planned flights with friends which had to be cancelled (and try explaining to non flyers why you can't go when the sun's out but the viz is 3K) and it all gets a bit irritating.
I've started doing the IMC, but even when I've got this it isn't going to make much difference. It would be foolish to T/O knowing you were going to have to use it.
All this conspires against continuing enthusiasm. My advice is:
1) Find someone to fly with, maybe someone more experienced to give you confidence. Flying with another pilot really does increase the fun.
2) Do some extra training such as IMC, night, complex etc. Having a focus rather than bumbling around aimlessly is good.
3) Try to arrange some impromptue days off work, where you can phone up in the morning if the weather's good and say 'I'm off flying'. It's usually easy to get a plane mid week, and the skies are lovely and empty.
Well, these have worked for me anyway.