Doing your own thing every weekend (i.e. Sat and Sun) is going to finish any relationship eventually.
That is the problem, as far as I can see, with gliding, or "serious" sailing. Power flying you can just do part-time, and if you have flexibility on weekdays you can do it then.
I think the best relationships are ones where each of you has their own "projects" but you spend time together in the evenings and say on Sunday. In too many relationships one person is "hanging onto" the other.