My experience may help a little.
I too am colour blind, I failed both the Ishahara and the three lantern tests so didn’t get the flying scholarship or the airline training I had banked on.
I got a PPL and the first few years I flew colts, tripacer, terrier and chipmunk, then of course the money got tight and for a while I flew Fourniers from Biggin but I was living in London and the traipse down and back to do 50 mins of flying became over tedious and as time went on I had even less disposable income. (Well, I was disposing it on a wife and many kids.)
Years later (29 years!) in Canada I saw an advert for a local flying school so I called to find out what I needed to do to get a licence. 5 hours, apparently. But flying spam cans was still expensive so I built an airplane and flew it for five or six years but once again cash got short. Sold it last year.
Maybe the world will turn yet again and I’ll build or buy another aircraft.
Learn to fly. It will always be with you and you never know where it will lead.