Sometimes it helps to draw a picture with mean sea level and aircraft altitudes to decide whether to add on the difference or to take it away.
Similarly, if you think about the aircraft you fly and the altimeter sub-scale knob, the altimeter needle will move in the same direction as you turn the knob. Have a look next time you fly!
Cheers
Whirls