A middle option 'twixt fly-for-fun and mortgage-the-family-in-the-faint-hope is to keep your current job and gradually train for the various licences & ratings - including instructor rating - for *fun*. Get known around your local schools by training there and becoming a known quantity. Eventually you'll be in a likely spot for part time instructing structured around your breadwinning job. Include part time ground jobs at a school too.
Be prepared for this to take years. Over that time you'll be surprised how often it leads to contacts that lead to further flying. One day your hobby might become your real job.