Never ever start a course that is not what you are actually best at doing - the aim is to get the highest A-Level grades possible, and the extra knowledge from A-Level Maths and Physics for ATPL exams is marginal.
What are you good at? Do that.
There are so few who require Maths and Physics that it is not worth bothering to take the risk of a lower result.