If somebody never carried passengers, I would have no issues with no medical.
The solo medically unqualified pilots who strikes an apartment complex and kills bystanders on the ground may not take anyone in the airplane with him, but it won't do those on the ground much good. It won't do the myriad of aviators in the air much good, either, for whom the medically unqualified flying hazard presents a collision potential, traffic conflict, distraction, or safety risk.
It doesn't do any of us any good when that passengerless, medically unqualified individual cracks up an airplane, skewing public perception of what we all do, and raises insurance rates.
If someone never carries passengers, it doesn't change one iota their need to meet the same medical standards and the same safety standards that apply to any of us.
A Medical for class 2 is just shy of $600.....to cough and read an eye chart.
Ridiculous. We pay sixty dollars for a class II. My first class is ninety bucks, and add the EKG, it's one fifty.
Six hundred; no wonder people want to eliminate the medical.
The problem becomes an economic one then. That is, when the chief complaint is based on the economics and not raw safety, then the complaint is grounded in the wrong soil.
Safety first.