I can't speak for the JAA/EASA side. But if you earn a FAA certificate, unless you do something really stupid, you'll hold that certificate the rest of your life.
Outside the EASA world, just about every country has a CAA. And they all issue licenses. You could end up with a wallet full.