Auzzie, you're asking in the wrong forum.
Here's an answer though - what's the point in even asking?
You obviously want to do it, you won't feel complete if you don't do it, and from your nonchalant attitude, you've no problem when it comes to falling back on your cushion if you do it and it doesn't work out.
Are you just seeking reassurance, perchance?
If so, I'd advise it's not such a healthy idea - just look at the first two replies to this thread. Whether they are right, wrong, optimist, pessimist, or realist, doesn't matter. When you are at your age and using the words 'Career Change' and associating it to aviation, you need something to believe in.
You obviously have that, and as you have your own buffers in place, I feel no guilt or irresponsibility in recommending you stay away from places like this (unless for technical/theoretical advice), and submerge into the real world of aviation (airfields) on your days off. Take the family, but be careful not to make them sick of it.
I know of older people than you who have started from scratch and got jobs flying airliners full of passengers. Fact.
That was in a different market, however, and there is definitely some truth in those first two replies...
Do what you need to do, but don't kill your soul and your life doing it
