As the aeroplane is N registered it has nothing to do with the Swiss CAA. FAR-AIM says that you can operate an N registered aircraft in a foreign State using a licence issued by that State. As you would be flying a N Reg aircraft operating under US Legislation then you can log the time. You only need a FAA licence to operate it outside your State of licence issue.