Never found it a problem, at no time was I ever aware of where the sun was positioned, though might be a handy reference depending on the type of flying you do, mine was VMC. A 707 passenger was alert to the fact that they was off course, being a frequent flyer on the route, due to the sun not being in its usual position and was subsequently shot down by a SU-15.
https://www.historynet.com/kal-902-i...d-an-airliner/