[mirror-admin] Please use --delay-updates

[Patrick J Cherry]

Hi Chuck,

On Fri 16 Apr 2010 at 13:41, Chuck Anderson wrote:

> On Fri, Apr 16, 2010 at 10:48:31AM +0100, Patrick J Cherry wrote:
> > Hi guys,
> > 
> > Is there any reason why a two-stage approach isn't used?  First time
> > sync everyting except the repodata stuff, deleting nothing.  The second
> > sync then deletes any old files, and syncs the repodata stuff.
> > 
> > That way the mirror stays consistent.  And this seems to work for other
> > distros.
> 
> Each time you run rsync against your upstream mirror, it scans the 
> entire filesystem to build a filelist.  This could take anywhere from 
> 5 to 20 minutes or more and has been a factor in overloading the 
> master mirrors in the past.  So by using a multi-stage sync, you are 
> multiplying this and adding even more load to the upstream mirrors.

Fair enough.  I had assumed there would be a simple enough answer!

-- 
Patrick J Cherry                               Bytemark Hosting Support
                                             http://www.bytemark.co.uk/
                                              tel: +44 (0) 1904 890 890

--