Are you also going to suggest that it's not safe to have a wheelchair user as a passenger
No comparison! In order to qualify as a pilot one has to demonstrate certain skills. That involves interpreting information in the formats that it is commonly found in. If you cannot do that, then you do not posses the necessary skill to be given a licence. If you're 4 ft 3 you are not going to become a basket ball player! The fact that information could be provided in another format is not relevant until all information is available in that format.
A passenger can be assisted, a Pilot in Command cannot!