I feel for you... currently studying Linear Algebra part-time to keep myself amused, and it is brutal
If your intention is to fly anyhow, and you are truly motivated why not wait and finish the course? You have many years ahead of you and you really never know when the degree may open doors.
Think of it as a chink in your armour... you never know when you may need it.
On the other hand... truly... given the fees and expenses... does make you think twice.