[mirror-admin] Please use --delay-updates

Mike McGrath mmcgrath at redhat.com
Tue Apr 20 10:48:12 EDT 2010


On Fri, 16 Apr 2010, Carlos Carvalho wrote:

> Chuck Anderson (cra at wpi.edu) wrote on 16 April 2010 08:41:
>  >Each time you run rsync against your upstream mirror, it scans the
>  >entire filesystem to build a filelist.  This could take anywhere from
>  >5 to 20 minutes or more
>
> More... :-(
>
>  >and has been a factor in overloading the master mirrors in the past.
>
> I'd say nowadays too... The table below shows the time we take just to
> get the file list from sync.fedoraproject, for the last days. We
> mirror everything starting from release 11. It shows clearly that the
> machine suffers significantly from disk scanning. The file list is
> only about 22MB. Times are in UTC-3.
>
> If fullfilelist was done properly we could completely avoid this
> scanning...
>

Can you expand more on this, how can we do fullfilelist properly?

	-Mike

--


More information about the Mirror-admin mailing list