Surely it's more than just a question of money.
Without being too idealistic (I hope), if it's what you want to do, then go. If you're going to be happier in the long run then you'll find a way to make the finances work.
I have to say, though, it's a brave move if you do. AND I hope the Command chain take note... (chances of that....)