Fedora 2 is an excellent base for MySQL - I've not tried Fedora 3 but I would have thought it will be absolutely fine.
Remove all the old versions of MySQL (find out what is installed: rpm -q -a | grep -i mysql then remove them in turn). Download and install the new MySQL 4.1 RPM packages. It should be completely straightforward.