1) Most machines are on Windows 7 but one laptop is using XP and suffers the same issue.
2) I used the HP setup program on them all.
It's been suggested to me that disabling uPNP on this router might help. I've done that, rebooted and now it's just a case of waiting to see if it's stable now or drops again.