Yes you can fly a G-reg aircraft VFR in the UK and overseas. If you also have an FAA IR then you can fly IFR as well but only outside CAS.
It's a good idea to get a couple hours with an instructor over here since the R/T is a bit different and the airspace is rather more crowded than the states. Your club will probably require that you do this anyway.