What kind of connection do you have Alex? Dial-up will always give different download speeds. Cable or DSL are much faster using broadband connection, but even the can slow down at peak times of use.
See if the slowdowns are occurring at certain times of the day. If so, avoid those times.