[mirror-admin] quick-fedora-mirror (Was: fullfiletimelist broken??)
Jason L Tibbitts III
tibbs at math.uh.edu
Tue May 17 17:27:13 EDT 2016
>>>>> "KF" == Kevin Fenzi <kevin at scrye.com> writes:
KF> Sorry for the confusion here. I really hope you can take a look at
KF> the script that tibbs has come up with (when ready) and provide
KF> feedback.
For reference, we're talking about https://pagure.io/quick-fedora-mirror
Some info and docs are there in the overview.
The server side file list generation was implemented recently, which is
why the (not previously announced) fullfiletimelist file on the Fedora
mirrors has changed format. The old file did not have sufficient
information to enable proper mirroring, and was a real pain to parse.
The code is ready-er than it was yesterday. (I only started working on
this over the weekend.) I still have a load of testing to do, but
everyone is welcome to test what's there now. It does actually work for
me, enabling me to poll the mirrors very quickly and with very little
load on Fedora's servers. It should also work for mirrors polling other
mirrors, as long as they keep the same module and directory names as the
master mirrors.
The only real caveat right now is that it's written in zsh. Once I get
it in a state that I'm not redoing big parts of it, I will port it to
bash so that hopefully admins won't need to install anything at all in
order to use it.
If anyone would like to use this but doesn't have bash4 (RHEL5, ugh),
please let me know and I'll see what I can do. bash3 is pretty spartan
but it should be doable. Though I'd really prefer that someone send me
a pull request instead.
Outside of bash and rsync, it just uses awk and the plain old utilities.
- J<
--
More information about the Mirror-admin
mailing list