So long as the aircraft is permitted to be there, you can legally fly it.
Bear in mind that permit aircraft don't have the same rights under the Chicago Convention as those with an Annex 8 C of A. So while it is (currently) your right to fly a G-reg PA28 in another Contracting State with a non-UK licence rendered valid by the UK, that right does not extend to permit aircraft.