Yes my point exactly and by reducing the lift during flap retraction and in order to keep the load factor the same the pitch attitude increases slightly, because only by keeping the lift at a constant will keep the load factor at a constant.
If the pitch attitude remained the same during flap retraction the load factor would reduce as the rate of climb would temporarily reduce which would temporarily cause a reduction in load factor.
Pretty basic stuff really