Hallo there,
The question you have to ask yourself firstly is: "What if.........?" For example: If there is an engine failure on departure, which pilot will have the best view of all the obstructions? Furthermore, if the emergency occurs before the committed call, will the handling pilot have sufficient visual cues for the reject?
The pilot not having a clear view of all the obstructions on the approach and arrival path is certainly not in a position to assess the potential hazards associated with the facility (rig, ship, etc). Regardless of the cockpit gradient or experience levels, the pilot that will ensure the safest arrival/departure from a facility is to do the flying.
There are other instances where both pilots can do the approach/departure, like landing on a gas ship where the deck is situated in such way that the approach and departure paths are clear from either side.
Hope that answered your question and concern.
Cheers,
CJ