There is not much of a case for not upgrading your browser. You may notice a slight increase in performance, but, as RTFM has stated, you will benefit from the increased (!) security from a more up to date program. Don't forget to visit Windows Update as soon as possible after install to download yet more plugs.
Incidentally, I'm using some java based site at work which will not work on anything earlier than IE5.5
Tim