(until I ask them to either stop doing so, or otherwise hand over their duties as PF or PNF to me and take an official Crew Fatigue Management break, doing with it as they see fit)
The cockpit environment must be pretty boring. It if happens regularly on your flight then, take a good inward look, otherwise they may be looking next at the escape rope round the neck, after a 4 sector day.