Right click on the icon, select properties, and click on open file location then delete everything there (if you click on the first one. scroll down to the last one hold down shift and click it will select all of them or one of the menus may give you 'select all' option)
When you've done that right click on the icon and select delete.
Alternatively, Right click on the icon, select properties, make a note of the 'start in' location, open windows explorer and locate that folder and delete it,
After either, down load something like CC Cleaner and clean the registry.