Don't worry about it. Lots of people (who have no idea about aviation) will tell you that you need a PhD in maths and a separate PhD in physics to be a pilot...
As long as your maths is half decent and you have a understanding of physics you'll be fine.
I did my ATPL exams with Bristol and before you even crack on with the subjects you have to complete a number of maths and physics lessons just to brush up your skills. It's nothing complicated, though and in fact for someone like me who finished school years prior it was quite helpful as you tend to forget these things for not using them.