My attention was diverted by something for probably only four or five seconds and when I looked back at the AI I was in a 30 degree left turn.
Yes, that happened to me once. The "distraction" was the examiner on the IMCr test insisting on being shown in more and more detail exactly where I thought I was on the map ... which he clearly did entirely on purpose to demonstrate to me what happens if you take your eyes off the instruments.