By day, with good forcast on the weather chart ( wich is rarely the case our days ...) and on a trip with less than 4 hours ... and .. and ... and ... from my office ( nice & warm ) I can say I would have continue ...
But would have felt very unconfortable. It is acockpit decision, so if my collègue don't like it, then I do respect his opinion.
If some don't fell good in the cocckpit, let's change the situation ! First step for a safe flight !