I hoped to be able simply to plug one or two of the spare routers into telephone connectors in other parts of the house.
Can't be done, period.
You can get hold of ethernet over power line devices instead of running CAT5 cable to connect the routers (littering up your cupboard) as GG has suggested (and it would be permanent).
SD