What specfically causes the apparent reduction in visibility in this case?
The direct light from the sun exceeds the reflected light from the ground by a margin that exceeds the dynamic range of the optical nerve. Much the same occurs with a camera. If you move your focal point away from the light source so that you use your periferal vision, you should be able to see more.