Does it look like ¶ that?
That's a "paragraph" sign. I don't use Outlook, but in Word and that ilk it means you've turned on "show formatting characters".
Are you sure it actually appears in e-mails you send out? Some of those things only appear on your screen.
There is an article
here which talks about something similar.