All IRS units precess to some extent and this limit is usually considered at a maximum of 2 NM per hour. With radio/GPS updating the nav computer is quite accurate. You are quite correct, the Airport Reference Point is..."close enough." Some will disagree of course, but I have found it quite OK.