[ale] Fault Tolerant High Read Rate System Configuration

[Jeff Layton]

Since you're hitting small files (less than 1MB), I would guess you're more IOPS driven than throughput driven. Also, since it's primarily reads, why not consider SSDs? They are pricey, but they have really good read performance (much better than their write performance). If you need even more performance, you can use RAID-0 across a few of them.

If you want to do HA then put the primary source of data on an iSCSI SAN and then rsync the data between it and the SSD's in two nodes. 

One other option if you need even more performance is to use a ramdisk. I'm not sure how an HA configuration would look like in this case though... (never tried that).


I think it's worth an experiment to try the SSD's. You can get a couple of Intel drives for less than $1K. It would be good to see the performance difference between it and the current system.

Jeff




________________________________
From: Greg Clifton <gccfof5 at gmail.com>
To: ale at ale.org
Sent: Tuesday, July 28, 2009 11:35:31 AM
Subject: [ale] Fault Tolerant High Read Rate System Configuration

Hi Guys,

I am working on a quote for a board of realtors customer who has ~ 6000 people hitting his database, presumably daily per the info I pasted below. He wants fast reads and maximum up time, perhaps mirrored systems. So I though I would pick you smart guys brains for any suggestions as to the most reliable/economical means of achieving his goals. He is thinking in terms of some sort of mirror of iSCSI SAN systems.

Currently we are only using 50G of drive space, I do not see going above 500G for many years to come. What we need to do is to maximize IO throughput, primarily read access (95% read, 5% write). We have over 6,000 people continually accessing 1,132,829 Million (as of today) small (<1M) files. 

Tkx,
Greg Clifton
Sr. Sales Engineer
CCSI.us
770-491-1131 x 302
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.ale.org/pipermail/ale/attachments/20090728/818ba4b6/attachment.html