Some MBs suggest that you change the battery with the power on so as not to loose the settings.
Windows should see the graphics card as a new hardware device every time it starts unless you've turned off plug 'n' play. I suspect you might have an intermittent connection somewhere and not necessarily the battery, when you press the battery you are also flexing the MB.