The initial part of the training should be done in good weather. It allows consistency in training with no huge gaps. This is for the handling part of the PPL. (eg stalls, steep turns, circuit work etc).
For the cross country bits, you want a mix of weather conditions so you learn to interpret the met reports and apply sound decision making to your flights.