This pitch rate will be generated by both the elevator and the stabiliser but the pilot has no sense of the relative contributions of the two controls. When the desired pitch attitude is achieved, aft movement of the yoke may not stop the nose down pitch rate if too much stabiliser trim has been applied and even with full aft yoke the nose may continue to pitch nose down.
15 seconds of trim, flaps up, will change the in trim speed by 100 knots (737-800). It would be more speed / less time with flaps out.
I wonder what the perception would be if the other pilot were applying some opposite force to the yoke.