[mirror-admin] "file has vanished" again

[Mike McGrath]

On Fri, 16 Oct 2009, Rob van Nieuwkerk wrote:

> On Fri, 16 Oct 2009 09:52:25 -0500 (CDT)
> Mike McGrath <mmcgrath at redhat.com> wrote:
>
> > On Fri, 16 Oct 2009, Chris Adams wrote:
> >
> > > Once upon a time, Mike McGrath <mmcgrath at redhat.com> said:
> > > > On Thu, 15 Oct 2009, Carlos Carvalho wrote:
> > > > > Chris Adams (cmadams at hiwaay.net) wrote on 15 October 2009 12:56:
> > > > >  >I'm seeing more of the rsync "file has vanished" messages again, and
> > > > >  >they seem to persist for hours.  For example, today I'm seeing:
> > > > >  >
> > > > >  >receiving file list ... file has vanished: "/linux/development/source/SRPMS/anaconda-12.37-1.fc12.src.rpm" (in fedora-enchilada)
> > > > >
> > > > > Same here.
> > > >
> > > > Where are you syncing from and what file are seeing the same file vanish
> > > > every time or a different one?
> > >
> > > Syncing from download3.fedora.redhat.com (also seen in a test on
> > > download1).
> > >
> > > Yesterday, I saw the same anaconda-12.37-1.fc12.src.rpm "vanished" for
> > > hours.  Eventually it came through.  I saw the first "vanished" message
> > > at about 07:30 CDT and again several times up through 18:00 CDT.
> > >
> > > It appears that this was a file to be deleted yesterday (it was deleted
> > > here in a run that started at 23:00 CDT), so maybe the problem is on the
> > > delete side of syncing (deleting from the filesystem but not the
> > > metadata?).
> > >
> >
> > K, I have a hunch I know what this is.  These shares are all on nfs and we
> > have a fairly high actimeo set.  I'll see about tuning this value.
>
> Hi,
>
> This "file has vanished" behaviour is not new: I see it all the time
> and I've reported it several times over the years, but I kind of gave
> up on it.
>

Do you see it with mirroring other distributions?

	-Mike

> It's more or less a cosmetic problem.  But it's a bit annoying because
> rsync does the "IO error encountered -- skipping file deletion" thing
> and your mirror can get full because of it.  And thus manual intervention
> is needed :-(
>
> The "file has vanished" seems can last for days on the same files.
> So it's certainly not a thing that only happens when you happen
> to rsync while the master is updating.
>
> 	Friendly greetings,
> 	Rob van Nieuwkerk
> 	ftp://alviss.et.tudelft.nl/
>
> --
>

--