Did you experiment with the squelch setting on the intercom? That's fixed about 90% of similar issues I've had. Failing that it could be a dodgy electrical connection somewhere between the passenger headset jacks and the intercom but I'd experiment with squelch first.