Version 6, Update 5 is the latest. If you've got that installed anything earlier is a waste of space. I found, like you, that new versions don't delete the earlier ones and just keep cluttering the hard drive.
My "Add or Remove Programmes" shows " Java(TM)6 Update 5", and this works O.K.