Must be said that on my initial IMC test the examiner commented afterwards that yes, I had made a few mistakes, but I'd always spotted them by double-checking within 30 seconds or so and told him ('whoops - that was supposed to be heading 145 not 154!', that sort of thing), so safety was never compromised. But I agree, I fly much better when I've got no-one to talk to; passengers distract me.
Tim