[mirror-admin] Why still *lots* of download in releases/11?

[J.H.]

Carlos Carvalho wrote:
> Jesse Keating (jkeating at redhat.com) wrote on 6 June 2009 12:13:
>  >I just sampled a few packages on the master server, and the rpms in
>  >Everything/ have the same inode as the rpms in development/.
> 
> Confirmed, updating from download.f.r.com does hardlinking. It's
> kernel.org that's broken.

*sigh* This looks like more 'excitement' with respect to the newly 
requested rsyncFilter and the brokenness / churn that happened recently.

Specifically this *was* hard linked when rsyncFilter set things up to be 
synced in a single go (development and 11/ directory), however when the 
permissions got thrashed on the 11/ directory and it got deleted then 
changed back and resyned back out *poof* no more hard linking as the two 
directories weren't in the same sync (in fact the development directory 
was explicitly excluded as nothing had changed there).

My European machines are fine, as they were syncing slowly enough to 
have completely missed this.  However my US machines with better 
connectivity to the masters got thrashed, and I only run a forced full 
sync once a week, which would have caught this but that's not scheduled 
to run for several hours yet.  I've got rsyncs going which are fixing 
the hard links now, should be done soon but this is definitely something 
that the Fedora guys need to be aware of, and something that rsyncFilter 
might need to actually know of / be able to deal with going forward 
since screwed up permissions on a release directory are a bit of a 
common occurrence.

I'll talk with Matt Domsch about it, but I will likely need to start 
forcing a full sync (ignoring rsyncFilter) at least once a day.

- John 'Warthog9' Hawley
Chief Kernel.org Administrator

--