If only... it got to a point where they threatened to stop people leaving NZ unless they had finished all the progress tests first.
It's probably not the worst idea to do it all before going out there - much of my ATPL theory knowledge has come from actually working on the line rather than trying to learn from the Bristol CBT software that has been the norm until now. Doing it all beforehand will make you actually pay attention to the stuff rather than staring into space while hearing your finger go "click... click... click..." on the mouse.
I'd echo jb5000's point though that all it means is you'll have less to do out there in the inevitable gaps in the flying due to weather / scheduling / etc etc. Still, more time to enjoy the Hamilton 'nightlife'...