If ATC tells you QNH is 1024, you set 1024, even if the altitude showing is wrong.
Would it not be better that everybody flies with the same QNH, instead of somebody making their own personal rules, and sets 1023, because that gives correct apron elevation.