ChiSau,
I'm at exactly the same stage as you - had 3 lessons so far. Although this isn't my first experience with IMC flying. Last year, I did a cross-channel checkout, as required by my club, and on the day of the checkout it was solid IMC all the way to the coast. Talked it over with the instructor, and we decided to go anyway. I did all the flying, she did all the navigation (until we reached the coast, when the clouds cleared). Logged about 2 hours of instrument time, and I was absolutely exhausted!
After my first IMC lesson, I was just as tired as I was on that cross-channel flight. Took the foggles off on downwind, attempted to fly the same circuit I fly all the time, but was too tired to figure out which way to turn!
I'm just starting to get the hang of it now, though. After my last lesson, I managed a pretty good landing despite the 15kt crosswind, and still had enough life left in me to go out for the night. So stick with it, and I'm sure it'll get easier. I think I have a little more total time than you, and that probably counts for something (not sure how much it counts for though!) - so there's definitely nothing wrong with you!
Good luck!
FFF
-------------