I had a similar problem.
I had a cable modem. Although the Thruput was enourmous, I could wait minutes for the transfer to start. Complained to the cable company, they said it was my machine. Hooked up DSL and problem went away.
I suspect that it is your internet service provider.
Cheers
Wino