There is no max on N or any other reg, other than the 5% mentioned by Lucy if not maintained to PT standards.
Where a limit of 4 might come on an N-reg is that above 4 the DfT will not give the "aerial work" training permission (max 4 shareholders, or max 4 Directors of plane is owned by Ltd Co - details on the DfT website somewhere).