[mirror-admin] Breaking the 1TB limit?

[Stephen John Smoogen]

On Mon, Feb 22, 2010 at 1:27 PM, Stephen John Smoogen <smooge at gmail.com> wrote:
> On Mon, Feb 22, 2010 at 1:01 PM, Chuck Anderson <cra at wpi.edu> wrote:
>> On Mon, Feb 22, 2010 at 01:08:36PM -0600, Matt Domsch wrote:
>>> 1) do many mirrors have more than 1TB they would be willing to use to
>>> host Fedora content?  If so, how many, and how much more?
>>
>> I've been struggling with keeping my mirror in the 1.5TB I have
>> available for Fedora.  As it is, I've had to move CentOS/EPEL to a
>> separate 300GB disk array, and I've started deleting old Fedora
>> releases, first 1-4 and now 5.  Once we finish the migration of some
>> older boxes to CentOS, I'll be able to delete all obsolete releases to
>> free up more space, about 455GB, bringing me back down to about 1TB,
>> and leaving about 500GB free.
>>
>> So, I guess for right now I'd rather not see Fedora grow past 1TB, but
>> in the future (F14-F15 time frame) I could go up to 1.5TB.
>>
>> Money is tight right now for upgrading to larger/more storage.  Anyone
>> here play with cheap 1-2TB SATA disks + 3ware RAID cards for their
>> mirror?  What do you use for external enclosures?  Is this really a
>> viable option from a performance and reliability standpoint?
>
> Most of my experience has been helping people try to get data off of
> them at one point or another. The big issue with the large disks are
> that they are slow. You can overload them pretty quickly to the point
> where you may have 16 TB of data in your raid, but effectively you can
> only use 1-4 because of load :(. Maybe the larger block sizes will
> help with this.. but a lot of it is just how many platters you can
> read/write at once (at 5400 to 7200 RPM versus 10-15k)
>

Oh I have seen some good things where you put the older stuff on the
big slow disks and have an array of fast disks to keep current fast
stuff on. So 2 TB raid array for anything in the last 9 months and
everything else gets put out to pasture.


-- 
Stephen J Smoogen.

Ah, but a man's reach should exceed his grasp. Or what's a heaven for?
-- Robert Browning

--