I downright sucked at anything maths-related in school, but I think that was mainly due to lacking interest.
Once I got into flying, the math just comes with it (especially during your instrument rating), and I just didn't mind - even wasn't so bad at it in the end.
A lot of what you'll need in everyday flying will relate to rules of thumb for things such as rate of descent, ground speed, wind correction angle etc... and anything related to speeds versus time and distance.
Not too hard to figure it all out once you see what it's good for.