Happened to me once when we got a last minute runway change and changed everything except the course selectors. When intercepting out of a 30° intercept the aircraft tried to turn outbound and intercept the ILS along the set course. Of course we noticed the mishap then and corrected it.
Once again, switching the autopilot off and just flying it was the easiest option.