[mirror-admin] Please use --delay-updates
Mike McGrath
mmcgrath at redhat.com
Tue Apr 20 10:48:12 EDT 2010
On Fri, 16 Apr 2010, Carlos Carvalho wrote:
> Chuck Anderson (cra at wpi.edu) wrote on 16 April 2010 08:41:
> >Each time you run rsync against your upstream mirror, it scans the
> >entire filesystem to build a filelist. This could take anywhere from
> >5 to 20 minutes or more
>
> More... :-(
>
> >and has been a factor in overloading the master mirrors in the past.
>
> I'd say nowadays too... The table below shows the time we take just to
> get the file list from sync.fedoraproject, for the last days. We
> mirror everything starting from release 11. It shows clearly that the
> machine suffers significantly from disk scanning. The file list is
> only about 22MB. Times are in UTC-3.
>
> If fullfilelist was done properly we could completely avoid this
> scanning...
>
Can you expand more on this, how can we do fullfilelist properly?
-Mike
--
More information about the Mirror-admin
mailing list