There is no restriction on flying from the UK to France and back without a transponder provided you stay outside Class D airspace on the French side. If you want to visit an airfield within Class D you may be able to get PP or you could just turn up an you will probably get away with it (not the way I would go).
Rod1