Why does it have to be a permanent decision? Do you have a favourite restaurant? Would you go every night? Same with hobbies/pastimes. You do them as the desire takes you.
What's wrong with packing up flying? You don't want to do it anymore so it would seem to be a no brainer. You can always come back to it. I've jacked in and restarted gliding several times. Same with fishing and golf.