[mirror-admin] Next Generation Mirroring Project

Warren Togami warren at togami.com
Sun Apr 12 23:58:37 EDT 2009


https://fedorahosted.org/InstantMirror/

I have wrote down design notes of the new InstantMirror project. 
InstantMirror aims to solve many of today's problems in mirroring large 
repositories of data like Fedora, Debian, kernel.org or CPAN by 
combining various existing methodologies like rsync, torrent-like 
swarming data replication, and squid-like caching algorithms.  The 
design is influenced by my personal experience dealing with problems of 
running the usual rsync mirror, subsequent attempts to do it differently 
with a reverse proxy cache, and John 'Warthog9' Hawley's experience 
running massive capacity mirrors for kernel.org where high performance 
is needed.

This project is meant to be fostered in Google Summer of Code 2009, with 
multiple Red Hat and Fedora community mentors, working together as a team.

I believe folks here may be interested in helping to make InstantMirror 
a reality, because it would dramatically reduce load on the master 
mirror, make mirroring globally faster, while reducing the incidence of 
error and necessity of manual intervention for mirror administrators.

https://fedorahosted.org/InstantMirror/
https://www.redhat.com/mailman/listinfo/instantmirror-list
irc.freenode.net channel #instantmirror

Please read the design notes and I hope folks can get involved in the 
project.

Thanks,
Warren Togami
wtogami at redhat.com

--


More information about the Mirror-admin mailing list