Classic case, by the sound of it, of somebody who has seldom functioned outside the school environment, and thus has little grasp of real world flying.
Of course, an IAP in VMC demands see-and-avoid lookout, which I trust you did, as would any other sensible pilot. But that is absolutely not the same as a safety pilot (maybe it was in his club FOB and he didn't know the difference between that and the ANO?).
G