Op,
If you are still around, here's a slightly different take.
Life is short and where ever possible to be enjoyed. Maybe it's worth doing something you don't like for a short while to gain a reward, but in general if you are lucky/privileged enough to have choices, do the stuff that makes you happy.
Since this appears to be a hobby for you (I assume, possibly incorrectly, that you have no professional flying aspirations) it's pretty simple isn't it.
If you are enjoying your flying training and can afford it...continue.
If you are not enjoying it and/or it is too costly...stop.
One thing you should not do (in this or anything else). Make quitting something you have stopped enjoying a "failure" in your own mind.
Quite the reverse...continuing with something you don't enjoy, and don't have to do because "you want to prove something to yourself or anybody else" is emotionally weak and ultimately pointless.