One consideration I've not seen brought up is whether the A/P will be required to legally make a CAT2/3 approach at destination. If your ops specs/company procedures require it for the actual approach, not having it early in the flight might be another factor in the decision to go on/return.