GPS vertical measurements are referenced to the WGS84 ellipsoid model, not sea level or the local geoid. Additionally, the accuracy of the GPS vertical measurement is in the order of x 1.5 less than the lateral measurement.
It is possible to convert the height above the ellipsoid to the height above the geoid (i.e. the actual earth), but this still involves using a mathematical model with inherent inaccuracies.