[mirror-admin] download.wpi.edu filesystem corruption vs. not using rsync --checksum

Kevin Fenzi kevin at scrye.com
Sun May 25 13:56:00 EDT 2014


On Wed, 14 May 2014 14:56:21 -0400
Chuck Anderson <cra at wpi.edu> wrote:

...snip...

> Should we consider deploying the --checksum option to rsync?  I know
> it slows things down, but by how much I'm not sure.
> 
> [1] https://fedoraproject.org/wiki/Infrastructure/Mirroring

The rsync man page says: 

"Generating the checksums means that both sides will expend a lot of
disk  I/O  reading  all the data in the files in the transfer (and this
is prior to any reading that will be done to transfer changed files),
so this can slow things  down  sig‐ nificantly."

So, I think it's not going to be very nice for us to enable it, since
we already are hammered on I/O. 

I suppose we could try enabling it on one of our download servers and
see how swamped it gets next to the others? And/Or have you test
against it? 

kevin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 836 bytes
Desc: not available
URL: <http://mail.ale.org/pipermail/mirror-admin/attachments/20140525/7a5552a3/attachment.sig>
-------------- next part --------------
--


More information about the Mirror-admin mailing list