In my experience you are OK with pretty much any modern browser provided it is regularly updated and patched. It is what you do with it what matters.
I would say that summarises things nicely. Layered security. Keep your computer up to date, don't run as admin user, preferably use a seperate hardware firewall, and keep your wits about you and your average user should be safe from many threats.
Unfortunatley too many people frequently forget to take care of the weakest element, the user.