I'd second all that Genghis says. Gliding (my first passion) proves to be an excellent background for other forms of aviation (more recent pursuits), and is a great route into them - we have plenty of club members who went on to the RAF and/or airlines, but who still come gliding at weekends. And any other way of getting into the air is good!
You don't need university physics, maths or engineering, but they certainly help! I teach physics at Genghis's alma mater, and practice and theory of flying in all forms are both more interesting and understandable with a bit of scientific knowledge and an inquisitive approach. If I ever have the time, I'd love to develop an optional course here on the physics for flight, because it provides so many interesting examples of fundamental phenomena.
Good luck with your flying!
Windrusher