If it's a very old machine, USB HDDs and DVD writers may not work (needing USB 2.0 vs USB 1.1). Also, Windows 98 may have trouble coping with HDDs larger than 128 GB.
I would suggest you concentrate on backing up the data itself rather than the whole system. After all, you've said that if it goes pop you'll buy anew.