Will happen if you are using a pop3 connection which gets broken or times out partway through downloading emails.
The pop3 implementation first downloads all mail items and then goes back and deletes them from the server, so iftheconnection ios broken before the process ends you have to start again at the beginning, hence duplicate emails.