To pan left you push the stick to the left, Right for right, forward to pan UP, and Back to pan DOWN.
Not all implementors of user interfaces agree on this one. An approach which I might have hoped would be more common is to let the user choose, ie have the sense of the controls as a user selectable option.
When I steer with a tiller I sit side on to the forward motion.
You might do in a sailing dinghy. You don't in a 30-ton narrow boat - you stand facing forward, as I guess you do in a yacht that has a tiller rather than a wheel.