In Windows Explorer navigate to the folder you want to change the icon. Do not open the folder.
Right click the folder, select Properties, open the Customize tab, click on Change Icon.....
Any file with the .ico extension can be used to replace the standard icons.
You can also show a picture on the folder. In this case click on the Choose File in para Folder Pictures in the same tab as before.