I'd say that doctors, like pilots, can never be sure of anything. That's why there's procedures and judgement.
Anxiety is an old friend of mine. It's also hard to diagnose. Is there anything else you've noticed that isn't right?
Disclaimer: I am not a doctor, or fakedoctor. And for God's sake, don't use the Internet for medical advice.