I too am a relatively low hours PPL student. Just starting to bash the circuit working towards that ever closer first solo.
I am finding that my nerves are getting better with each flight. Last weekend I turned up at the airfield for a lesson and winds were gusting at 20-25 knots, right across the runway.
My instructor told me that it was not the kind of weather for me to be learning take-offs and landings just yet, but that if I was feeling brave we could do some work on keeping a rectangular circuit in relatively strong wind. It was definately very interesting. It is a little strange to be pointing in one direction but actually moving in a slightly different one.
The wind and the turbulance definately had me on edge, and I have experienced a few of those 'sudden banks' that you mention. Quite scary at 50 feet!
The biggest problem I have when I get nervous is that I hold on too tightly to the yoke and consequently apply back pressure, this means I screw up the trimming. I am getting better though. Whenever my instructor points it out, I always comment that it is a weird thing to do logically. If the aircraft falls, the yoke will be coming too right?

. Human nature is a funny thing!