[mirror-admin] MM crawler now every 4-5 hours

Matt Domsch Matt_Domsch at dell.com
Fri Mar 28 07:52:40 EDT 2008


I made some improvements to the MirrorManager crawler's launcher
yesterday, so now it constantly keeps 15 hosts being crawled in
parallel.  This has reduced the crawl time from about 12 hours to cover
everyone, to 4-5 hours.  This should mean faster update times for the
mirrorlist and publiclist pages - if the crawler thinks a directory
isn't up-to-date, wait a few hours (instead of 12) and it should
self-correct.  Of course, please continue to run report_mirror too.

Thanks,
Matt

-- 
Matt Domsch
Linux Technology Strategist, Dell Office of the CTO
linux.dell.com & www.dell.com/linux

--


More information about the Mirror-admin mailing list