Does #rsync usually vary very much in transfer speeds when transferring files? Moved some files today and transfer speed varied from 1 Mb/s to 110 Mb/s with very random sudden drops in speed.

Reply to this note

Please Login to reply.

Discussion

Someone probably opened a fridge

yes this makes sense, it shows effective rate, so if it doesn’t need to copy parts of a file/dir it will count that towards its speed

That’s the delta calc it does to figure out what to copy/transfer? I don’t think that makes much sense in this scenario though, because this was about moving entire files that didn’t exist on the target path before

Are you using -z ? compressibility would be a factor as well

Yeah I figured it could have something to do with the compression flag. It's a pretty beefy CPU on the remote machine though so wouldn't think that would be a bottleneck..

Intermittent packet loss

Any way to see if this happens?

The old days I'd run a ping from one device to the other and just leave it running and look and see if I was getting packet errors which correlated with the drops in throughput

Another thing which can cause dramatic drops in transfer rate is when the file system memory cache on the receiving machine fills up and it starts having to go to the hardware device with all the writes instead of just filling memory. A `vmstat 5` running on the receiving end will show that ...