That's relatively normal. Usually, when you download something you should get a big jump in latency (as your bandwidth is being saturated). Sometimes, this will be accompanied by a big jump in packet loss as well.

These symptoms are more true with lower bandwidth connections. As you increase bandwidth, you should see less latency jump and less packets lost, although it will still happen as you're saturating your bandwidth.