They will be none the wiser.
With most email clients you still actually receive the message as normal. All that happens is that the message is then automatically deleted or moved for you. So there is no way for them to know what happens to their message.
Cheers,
HaM