Are they still there after you've restarted the machine? Some file managers will continue to display folders after they've been deleted.
What process are you using to delete them? Normally, Windows Explorer, tab down to them, then click on them and "File" - "Delete" will do the job.