Try right-clicking the Windows Explorer short-cut you're using and choosing
Properties.
In the field
Target it should say something along the lines of:
C
WINDOWS\EXPLORER.EXE /n,/e,c
where
c: is the starting drive letter.
Pressing the "Windows key" + E should also start up a "correct" WinExp.