[mirror-admin] Please use --delay-updates

Chuck Anderson cra at wpi.edu
Fri Apr 16 08:41:05 EDT 2010


On Fri, Apr 16, 2010 at 10:48:31AM +0100, Patrick J Cherry wrote:
> Hi guys,
> 
> Is there any reason why a two-stage approach isn't used?  First time
> sync everyting except the repodata stuff, deleting nothing.  The second
> sync then deletes any old files, and syncs the repodata stuff.
> 
> That way the mirror stays consistent.  And this seems to work for other
> distros.

Each time you run rsync against your upstream mirror, it scans the 
entire filesystem to build a filelist.  This could take anywhere from 
5 to 20 minutes or more and has been a factor in overloading the 
master mirrors in the past.  So by using a multi-stage sync, you are 
multiplying this and adding even more load to the upstream mirrors.

--


More information about the Mirror-admin mailing list