I have no doubt that, in the midst of a busy/bumpy/tricky approach, such a thing could happen. I know I've been subjected to sensory overload on occassions.
Having said that, is there really any way to totally remove the possibility of such things happening ... short of a robotic arm sliding out of the panel and slapping you across the face?
An air services employee yelling in your ear that you are off track and lower than you should be at that point might help draw your attention to the matter and thus add a defence to block off a couple of holes lining up in the Swiss cheese.