I bet the only deviation from the ISA atmosphere wasn't the temperature. Remember that the altimeter is calibrated for the ISA atmosphere and the reading will only match your true altitude if temperature and QNH are according to ISA.
If I my memory serves me right you can add 30' (will be more at high alt.) to your true altitude per 1 hPa above ISA.