Does the router have an available ethernet socket? If so, try connecting one of your laptops to it via the wire.
Then open your web browser and type into the address bar
(and this may vary, but usually)
192.168.0.1
or
192.168.2.1
There should be some info in the instructions about what address to use.
This should bring up a password prompt. This will in most cases be admin for both username and password, but again check in the documentation.
Now you should see whatever set-up info is available. Again the documentation that came with the router should tell you about all the settings.
If you can't work it out from there, let us know the exact model of the router and we might be able to help some more.
