The training restriction only applies to "training for the initial issue of a licence or rating" - so the biennial flight with instructor or MEP, IMC and/or IR refreshers and renewals are okay on Private.
Isn't it the additional checks on Public that make the costs go up unless you fly enough hours that a 50 hour check falls due every 62 days (or whatever the time-limited checks are).