The CAA is not authoritative so far as the validity of the FAA Private Pilots Certificate is concerned.
If you fly an aircraft under circumstances in which your FAA licence validity is a requirement (such as N reg outside the UK), then you will be in violation if you do not have a current BFR.