The problem with ground school is that there is loads to learn and remember. Most of it is not that difficult but it's the sheer quantity that gets you.
I think most people agree that the trickier subjects include:
General Nav
Met
Principles of Flight