Well in theory you are not licensed to fly the aeroplane (being N reg and the FAA don't recognise your license in an N reg abroad). I am sure if you were ramp checked no one would care, but if an accident happened and insurance companies became involved then strictly by the letter of the law you have been flying illegally. I am sure insurance companies would exploit this to their advantage.