Yeah, Windows remembers everything you have ever plugged into it and sometimes this store get corrupted. Delete a problem device in Device Manger and when you restart/replug back it comes, with the same duff driver that is causing the problems.
Device Remover is an alternate freeware Device Manager for Microsoft Windows developed by Kerem Gümrükcü. Allows you to remove all trace of errant devices etc.Think of it as a Device Manager on steroids (a a VERY sharp knife!). Very powerful app - batteries not supplied. RTFM.
Official site has been down for ages so just Google for Kerem Gümrükcü (not a lot of 'em about...)
Plenty of places where you can find it, but check the SHA first.
Mac