You have told us that are smart - so you can choose a career, pursue it and make enough money to fly for pleasure, rather than as a career.
I know this sounds simplistic, but it is an option, and if you are determined, you might just find there are 2 pleasures in your life, flying (recreationally) and whatever career you choose, whether psychology or another career.
Good point from redsnail - find out if you really will miss out.
But if you aren't eligible, you aren't the only person to be disappointed at not being able to pursue your chosen career. Sometimes it's for medical reasons (especially mil flying) but other times it's academic performance not being up to the minimum etc. Both are frustrating, both are hard to fight.
You do have alternatives though, and if you drop your bundle, you really will make it difficult to achieve your dreams. I also think you should consider seeking professional help, as this is obviously having quite an effect on you.