Bill,
I doubt this has much to do with installing Yahoo Messenger, unless you've removed it and realised the speed improvement? tell me if I'm wrong.
There are a hundred reasons why mail delivery might be delayed. Are you using Outlook Express? and are you 100% sure it's being sent before you close down O.E?