You can usually use Slimbrowser or Avant Browser instead of IE as they both use the IE engine but, in a more pleasant way! Most sites will think your using IE, although some sites will still not operate properly.
MS updates do though work with both these two. However, as stated earlier - You cannot remove IE. I have IE7 and just use it occasionally when nothing else will work! But use Slimbrowser most often.