Tax is only paid in one place. I think you'll find thats what the dual tax agreement actually means.
However, where there is a tax paid shortfall, the difference might have to be made up. So if for instance one jurisdiction charges 25% overall, the NZ IRD will want any percetnage difference in their favour paid.
Thieving