That's not entirely right: it also depends on the state that a/c is registered in, e.g. I have flown in France/Holland/Germany/Belgium/Spain (and even Wales!) in a G-reg a/c on a UK-issued PPL. But when renting VH-registered a/c in Australia and N-registered a/c in the US I have had to rely on having some sort of local certification (varies from country to country). Hence I have had to get a US certificate and an Australian "special license" - both of which are valid only if my UK license is valid.
Generally speaking though, if you are a in an a/c that is registered in the same State you got your license in then its only customs / immigration etc you need worry about, not your license.
Ask an instructor in your jurisdiction (at your flying club?) and they should know the rules that apply for you.
Andy