The simplest way to remember it is that the altimeter tells you how high you above the point at which the actual pressure is that which the sub-scale reading shows (which could of course be below the ground).
This will also help with more complex altimetery questions in met and nav exams.