[mirror-admin] push mirroring plans

Ricardo J. Barberis fedora at dattatec.com
Wed Dec 17 13:30:47 EST 2008


El Miércoles 17 Diciembre 2008, Jesse Keating escribió:
> On Tue, 2008-12-16 at 22:17 -0600, Matt_Domsch at Dell.com wrote:
> > Thoughts?
>
> Why not something far far more simple, which is a site checksum.  Each
> time we put new content on the site, we update a checksum (it doesn't
> have to be an /actual/ checksum, just some int we increase).  Mirrors
> can more frequently stat the value of this checksum against what they
> have, and if it changes, they know to do a full rsync run.  If it
> doesn't change, they don't do an rsync run.
>
> This would allow mirrors to ramp up their polling of us to every 10
> minutes or even less, without worry of swamping our server with stats of
> files.

This is a good idea and could probably be done by mirror_manager, but be 
careful: we don't want every server to know about the updates and pull them 
all at the same time!!

> Any other solution is going to be "polling" in some form or 
> another, either a daemon listening for an ssh push, or a email server
> waiting for mail to come in.  This more simple method doesn't rely on
> the setup of additional infrastructure on the mirror side, just a slight
> adjustment to the cron jobs mirrors already have in place.  If we make
> the file available via rsync at a top level, or even different files at
> different logical sections of the master mirror it would be quite
> simple.

Hey, we could even rsync that checksum file first, before deciding if we 
can/have to start mirroring. That file could also tell us:
- No need to sync
- You have to sync, but later (e.g because someone else is syncing)
- You may sync now

Best regards,
-- 
Ricardo J. Barberis 
Senior SysAdmin - I+D 
Dattatec.com :: Soluciones de Web Hosting 
Su Hosting hecho Simple..! 

------------------------------------------

Nota de confidencialidad: Este mensaje y los archivos adjuntos al mismo
son confidenciales, de uso exclusivo para el destinatario del mismo. La
divulgación y/o uso del mismo sin autorización por parte de Dattatec.com
queda prohibida. Dattatec.com no se hace responsable del mensaje por la
falsificación y/o alteración del mismo.
De no ser Ud. el destinatario del mismo y lo ha recibido por error, por
favor notifique al remitente y elimínelo de su sistema.

Confidentiality Note: This message and any attachments (the message) are
confidential and intended solely for the addressees. Any unauthorised use
or dissemination is prohibited by Dattatec.com. Dattatec.com shall not be
liable for the message if altered or falsified.
If you are not the intended addressee of this message, please cancel it
immediately and inform the sender.

Nota de Confidencialidade: Esta mensagem e seus eventuais anexos podem
conter dados confidenciais ou privilegiados. Se você os recebeu por engano
ou não é um dos destinatários aos quais ela foi endereçada, por favor
destrua-a e a todos os seus eventuais anexos ou copias realizadas,
imediatamente.
É proibida a retenção, distribuição, divulgação ou utilização de quaisquer
informações aqui contidas. Por favor, informe-nos sobre o recebimento
indevido desta mensagem, retornando-a para o autor.

--


More information about the Mirror-admin mailing list