I went to uni myself and considered leaving throughout my first and second years to start flying, but didn't. I'm now currently training and wouldn't have it any other way, I don't think I'd have managed without the skills I obtained whilst studying - and I'm not talking about degree-specific technical skills, I mean life skills and experience. Chances are after a few years studying you'll be in a better and more mature place and you'll be better for it. Since you're mostly enjoying the experience as well, I don't think leaving is the right choice for you, I'm sure there will be aspects of your course you'll find you do enjoy too. It's easy to say the grass is greener on the other side.