If memory serves, PF replaced the Captain in the Left Seat (LS) after top of climb. PF would expect to relinquish the LS to the Captain later in the cruise, well before top of descent. PF would not have expected having to hand-fly the aircraft. Perhaps, as a matter of courtesy, he left the Captain's armrest settings in place. It would be interesting to compare the physical dimensions of those two pilots.