[mirror-admin] Breaking the 1TB limit?

[Paulo Licio de Geus]

On 22 Feb 2010, at 16:08, Matt Domsch wrote:

> 
> 1) do many mirrors have more than 1TB they would be willing to use to
> host Fedora content?  If so, how many, and how much more?
> 

At the moment our raid has 1TB free for expansion, but if needed I still can add a couple of drives to the box (fortunately, I have spare ones lying around), so the 1TB ballmark is not important of itself, just the total capacity of my mirror content.

> 2) do we have the bandwidth, collectively, to mirror that much more
> content?  Due to our use of Tiering, we have done a decent job of
> getting content out to our mirrors faster than in the past.  If we are
> pushing that much more content, can we handle it?

Ubuntu 9.10 was our highest hit at 400 Mbps for a couple of days, a bit less on the third day, then the usual fall off. At the hotest the disk subsystem was at 30--40% utilization, so we can estimate that, for the same pattern of usage that a Ubuntu launch causes, that we could go up to 1Gbps (but then the University people would be chasing me for taking the whole link:-). Mind you, I use only cheap drives, so they are all 7200 SATA drives, and of a previous generation, i.e. those drives are hosting a second-duty raid5, after serving another use. So, my mirror content are currently on a 5x1TB raid5, with 8GB to help caching. The machine also hosts a larger raid5 for internal use.

At least for me, bandwidth doesn't look like a problem, as long as the usage pattern behaves more or less like the one during the Ubuntu 9.10 launch.

--
Paulo Licio de Geus		    Internet: paulo at las.ic.unicamp.br
Instituto de Computação - UNICAMP   Av. Albert Einstein, 1251 
caixa postal: 6176		    fax: +55 19 3521-5847
13083-852  Campinas SP Brazil       http://www.las.ic.unicamp.br/paulo
skype: paulo.licio.de.geus
ICQ: 296462565 	GTalk: paulo.de.geus at gmail.com  MSN: paulo at ic.unicamp.br




--