[mirror-admin] report_mirror taking a long time to run

[Matt_Domsch at Dell.com]

Can you through a print statement in there, to see if the delay is in walking the disk, or if the delay is in the upload to the database?

I'll be out of the office and mostly offline for the next 4 weeks or so, expect very long delays in my responses, but I'll try to get at things when I return or as I can between events.

Thanks,
Matt

--
Matt Domsch
Technology Strategist
Dell | Office of the CTO


-----Original Message-----
From: mirror-list-d-bounces at redhat.com [mailto:mirror-list-d-bounces at redhat.com] On Behalf Of HEAnet Mirror Admin
Sent: Tuesday, June 22, 2010 5:17 AM
To: mirror-list-d at redhat.com
Subject: report_mirror taking a long time to run

Hi,

We've noticed that the report_mirror script is taking upwards of 3 hours to complete a run, even when no content is synced.

It took 5 hours this morning, when some content was synced:

Started report_mirror - Tue Jun 22 04:29:24 IST 2010 Category Fedora Linux directories updated: 553  added: 0  deleted 0 Category Fedora EPEL directories updated: 162  added: 0  deleted 0 Category Fedora Extras directories updated: 87  added: 0  deleted 0 Category Fedora Core directories updated: 426  added: 0  deleted 0 Category Fedora Archive directories updated: 1  added: 0  deleted 1037 checked in successful Finished report_mirror - Tue Jun 22 09:28:32 IST 2010

The only unusual thing about the above output was the large number of deletions in the Fedora Archive category. This content is static so the script should not see any changes.

Attached is our report_mirror.conf. We are running the latest version from trac, on an ubuntu hardy box with python 2.5.2.

rg

--
Rob Gallagher | Public Key: 0x1DD13A78

HEAnet Limited, Ireland's Education and Research Network 1st Floor, 5 George's Dock, IFSC, Dublin 1.
Registered in Ireland, no 275301
T: (+353-1) 6609040  F: (+353-1) 6603666 WWW: http://www.heanet.ie/

--