What decision is Captain's alone?
Presumably you do a comprehensive departure brief in which you state what you will stop for at different stages of the takeoff, as per the original question. Why then can the F/O not call "Stop" as per your briefing?