Depends how high the inversion is. You are really just concerned about the last couple thousand feet. The normal guidance is to apply the correction to altitudes inside the final approach fix.
Here's a short powerpoint from the US Air Force.
http://44rf.com/misc/USAF_AIS_Cold_WX_Altimeter.ppt