Have you tried just going solo around the airfield for a few hours? Then, build on that and maybe try some low level circuits (500ft) for a few hours, then step up to 700ft, then a 1000ft and then try a transit flight A-B and so on?
If the above is no use then a Transactional Analyst should be able to help you in addressing your fears.
Good luck! MB