I'm in a somewhat similar situation and had the same trouble trying to decide if this was a path I wanted to go down.
In the end I decided to go for it, I'd rather finish all the training and never get a job that to never have done it and always be thinking what if. I could always go back to my old career.
Also don't forget that pprune tends to paint a broadly negative picture of the job and the industry. if you loved your job and we're happy, why would you come on a forum to tell everyone about it? Much more likely to happen with someone who isn't having a positive experience.
Do it. Go modular, get a class 1 medical and your PPL as a starting point. Getting that far may even just "scratch the itch".