[mirror-admin] "file has vanished" again

[Rob van Nieuwkerk]

On Fri, 16 Oct 2009 09:52:25 -0500 (CDT)
Mike McGrath <mmcgrath at redhat.com> wrote:

> On Fri, 16 Oct 2009, Chris Adams wrote:
> 
> > Once upon a time, Mike McGrath <mmcgrath at redhat.com> said:
> > > On Thu, 15 Oct 2009, Carlos Carvalho wrote:
> > > > Chris Adams (cmadams at hiwaay.net) wrote on 15 October 2009 12:56:
> > > >  >I'm seeing more of the rsync "file has vanished" messages again, and
> > > >  >they seem to persist for hours.  For example, today I'm seeing:
> > > >  >
> > > >  >receiving file list ... file has vanished: "/linux/development/source/SRPMS/anaconda-12.37-1.fc12.src.rpm" (in fedora-enchilada)
> > > >
> > > > Same here.
> > >
> > > Where are you syncing from and what file are seeing the same file vanish
> > > every time or a different one?
> >
> > Syncing from download3.fedora.redhat.com (also seen in a test on
> > download1).
> >
> > Yesterday, I saw the same anaconda-12.37-1.fc12.src.rpm "vanished" for
> > hours.  Eventually it came through.  I saw the first "vanished" message
> > at about 07:30 CDT and again several times up through 18:00 CDT.
> >
> > It appears that this was a file to be deleted yesterday (it was deleted
> > here in a run that started at 23:00 CDT), so maybe the problem is on the
> > delete side of syncing (deleting from the filesystem but not the
> > metadata?).
> >
> 
> K, I have a hunch I know what this is.  These shares are all on nfs and we
> have a fairly high actimeo set.  I'll see about tuning this value.

Hi,

This "file has vanished" behaviour is not new: I see it all the time
and I've reported it several times over the years, but I kind of gave
up on it.

It's more or less a cosmetic problem.  But it's a bit annoying because
rsync does the "IO error encountered -- skipping file deletion" thing
and your mirror can get full because of it.  And thus manual intervention
is needed :-(

The "file has vanished" seems can last for days on the same files.
So it's certainly not a thing that only happens when you happen
to rsync while the master is updating.

	Friendly greetings,
	Rob van Nieuwkerk
	ftp://alviss.et.tudelft.nl/

--