Different DNS servers? That sounds very odd. Either the router should handle the DNS, or it should point all the PCs at your ISP's DNS server.
Mind you, I had nothing but trouble with Belkin kit, and in the end I gave up on it. I've not had many problems since.