Everyone finds their own path to a flying career. Just keep stepping in that direction and you'll get there. Don't listen to the negative comments of others who don't think it can't be done. For them it can't.
Stay in school. Take physics as an option when you can. If and when you have to borrow money to finance your lessons, a solid history of working towards your goals will grease the wheels.
Good luck.