[mirror-admin] Please use --delay-updates
Chuck Anderson
cra at wpi.edu
Fri Apr 16 08:41:05 EDT 2010
On Fri, Apr 16, 2010 at 10:48:31AM +0100, Patrick J Cherry wrote:
> Hi guys,
>
> Is there any reason why a two-stage approach isn't used? First time
> sync everyting except the repodata stuff, deleting nothing. The second
> sync then deletes any old files, and syncs the repodata stuff.
>
> That way the mirror stays consistent. And this seems to work for other
> distros.
Each time you run rsync against your upstream mirror, it scans the
entire filesystem to build a filelist. This could take anywhere from
5 to 20 minutes or more and has been a factor in overloading the
master mirrors in the past. So by using a multi-stage sync, you are
multiplying this and adding even more load to the upstream mirrors.
--
More information about the Mirror-admin
mailing list