Is it possible to side-step certain of the bureaucracy by having the aircraft foreign registered
Provided you have the required licence and an approved maintenance organization to comply with that governing bodies regs and issue the applicable MR then you should be fine.
Vincent operate their fleet of 1900's on the Kiwi register while operating in Australia.