I'm now only getting a couple of dozen of these per day, down from several hundred per day last week.
What fixed it? - my ISP started using greylisting on the server. This is very effective at the moment, but of course only gives a temporary window of relief as when enough people start using greylisting the criminals will fix their mail clients to cope with it.