The ability to fly another country's aircraft with an ICAO licence issued by another State is only recommended by ICAO for non-commercial operations.
You can fly a Annex II (non EASA) G Reg in accordance with Article 62 of the UK ANO, and an EASA G-Reg in accordance with
ORS4 No1163 for non commercial (private) flights.