Depending on the level to which you did the Maths & Physics (presumably at school), you will find that it comes back to you very quickly. Many of the books and courses are assuming very little knowledge (esp wrt physics) in the first place. However, if you had the knowledge once (and, at this level, physics ain't changed), your brain will drag it out of long-term archive quite readily.
Cheers
Whirlygig