This guy sounds like a looney to me. I agree get a second opinion. Flying does not require strength and is one activity where men and women can compete on equal terms.
You need to find a sympathetic doctor with experience of pilots with disabilities.
I am trying to remember the name of a book about a woman athlete (I think) who became paralysed (i.e.: far more disabled than you) who went on to become an instructor.
Stick to your guns Tikkiro. That arm wrestling trick seems crazy to me.