[mirror-admin] MM crawler now every 4-5 hours

Uwe Kiewel uwe at kiewel-online.de
Fri Mar 28 07:55:12 EDT 2008


Matt Domsch schrieb:
> I made some improvements to the MirrorManager crawler's launcher
> yesterday, so now it constantly keeps 15 hosts being crawled in
> parallel.  This has reduced the crawl time from about 12 hours to cover
> everyone, to 4-5 hours.  This should mean faster update times for the
> mirrorlist and publiclist pages - if the crawler thinks a directory
> isn't up-to-date, wait a few hours (instead of 12) and it should
> self-correct.  Of course, please continue to run report_mirror too.
>
>   

What is the difference for MM between crawling and using data from 
report_mirror?

Thanks,
Uwe

--


More information about the Mirror-admin mailing list