If, however, I leave Outlook running...
I bumped into something similar a while back. I used a little prog called KnockOut to show me whether Outlook was still running, and finally worked out that the antivirus was the problem. Skype, for example, can also cause this.