[mirror-admin] rsync filtering to reduce master mirror load

[Matt Domsch]

On Tue, Apr 07, 2009 at 04:21:06PM +0300, Meelis Roos wrote:
> > One of the things that's bothered me for a while is that each mirror
> > syncs itself to it's upstream mirror (either a master, Tier 0, or Tier
> > 1).  But in general, content on the master mirrors changes only a
> > few times a day (generally one rawhide push, one updates/ push, one
> > pub/epel/updates/testing push).  Most of the content doesn't change.
> > And running rsync to discover that nothing has changed is expensive on
> > the upstream server - millions of stat() calls.
> 
> One of my students is just trying to implement a metadata cache for 
> rsync server, using inotify to keep it up to date. Will see in a month 
> whether something comes out of it.

Good to know, thanks.  Last time I knew, inotify did not work on
NFS-mounted file systems, such as Fedora uses. :-(

-- 
Matt Domsch
Linux Technology Strategist, Dell Office of the CTO
linux.dell.com & www.dell.com/linux

--