Would not a flying instructor, especially the instructor/examiner who checked you out for your PPL be in a better position to see that you were fit to fly, rather than a visit to a doctor?
Unless your Dr., is a "shrink" there would be a lot he could apart from a quick BP check, would their?