How long does it take to switch to HDG mode or disconnect the autopilot and take over manually and stop an inappropriate turn?
Just a few seconds, certainly.
However, it would appear that (more than) a few pilots are so wrapped up with operating the FMS, common sense does not enter the picture.