[mirror-admin] New Mirror not being spidered and not showing up in mirror list

[Dan Hawke]

I registered our mirror officially a few weeks ago in the hope that we could
get it published to your mirrors page, and I have it happily checking in
with report_mirrors showing plenty of directories...

However, it isn't showing up in any of the mirror finder options - not on
the web page, not on the mirror locater script...  I suspect this might be
because it's never been spidered.  However, I can't figure why it hasn't
been spidered yet.

Our mirror is ucmirror.canterbury.ac.nz - for instance I see this in our
mirrormanager screen:

Last Checked In: 2009-12-14 01:20:18
Last Crawled:

Why aren't we getting crawled?

It's picking up categories, and I've linked them to URLs:
Hosts carry categories of software. Example Fedora categories include Fedora
Core and Fedora Extras.
Fedora Linux [Delete]
http://ucmirror.canterbury.ac.nz/linux/fedora/linux
ftp://ucmirror.canterbury.ac.nz/pub/linux/fedora/linux
Fedora Other [Delete]
Fedora Secondary Arches [Delete]
Fedora EPEL [Delete]
ftp://ucmirror.canterbury.ac.nz/pub/linux/fedora/fedora-epel
http://ucmirror.canterbury.ac.nz/linux/fedora/fedora-epel
Fedora Extras [Delete]
Fedora Core [Delete]
Fedora Archive [Delete]

Any hints/advice/configuration changes would be appreciated.

Cheers,
 
Dan Hawke
Linux Server Support
Server Group, Infrastructure Support
Room 208, Information and Communication Technology Services Building
University of Canterbury

mailto:dan.hawke at canterbury.ac.nz
http://www.icts.canterbury.ac.nz




This email may be confidential and subject to legal privilege, it may
not reflect the views of the University of Canterbury, and it is not
guaranteed to be virus free. If you are not an intended recipient,
please notify the sender immediately and erase all copies of the message
and any attachments.

Please refer to http://www.canterbury.ac.nz/emaildisclaimer for more
information.

--