Parking is the clue.
That's it Magus. Aircraft are piloted from the LEFT seat and are parked from the same seat. Parking guidance devices at most terminals are calibrated for left seat docking.
Aircraft designers figured early in the piece there was not much sense in having the loaders getting tangled up with the passengers,so pax board from the left and baggage is loaded from the right.