<div dir="auto">+1 for Supermicro and Tyan boards. Tyan doesn't keep up in the server arena like they used to (not as many products) but are rock solid. Supermicro is in many, many HPC racks and hosting services. Also rock solid. Their cases will draw blood so be careful. The remote management port is not shared with a regular nic like Dell (bad, bad, bad!).</div><div class="gmail_extra"><br><div class="gmail_quote">On Jun 16, 2017 9:11 PM, "Greg Clifton" <<a href="mailto:gccfof5@gmail.com">gccfof5@gmail.com</a>> wrote:<br type="attribution"><blockquote class="quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Raj,<div><br></div><div>I doubt HBA connected drives would have any higher throughput than motherboard connected ones. If actually running any parity based version of RAID, I'm SURE that the motherboard embedded controller + software RAID would be faster than hardware based RAID. In general there is much more surplus compute power on modern CPUs than on any RAID manufacturer's proprietary RAID controller chip.<br></div><div><br></div><div>Pardon the free advertisement for Supermicro (I do not work for them but have used them for most of our server builds for years), but In fact, many of their motherboards support up to 10 SATA drives (even up to 6 or 8 on uATX) and some also support up to 8 SAS. Plus, many of their boards have a 7 year life cycle. With even most "server class" single processor motherboards at less than $400, a less costly option than using HW controllers would be to simply build the NAS system with a quality motherboard and buy a spare motherboard when you build. That way should something fail, it is a relatively trivial matter to swap out the MB and everything should go back to working with minimal tweaks of MAC address and such. Barring a lightening strike or other major power surge, you would probably get many years service out of such a system without ever replacing the MB. </div><div><br></div><div>As a side note we ran a 3Ware IDE RAID system on a Tyan motherboard in our own 2U rack chassis at CCSI for well over 10 years until the second or third round of drives failing (originally 80MB then 250MB). We decommissioned it when we couldn't get newer drives to work with the old 3Ware controller, but otherwise the system was still fully functional. All that to say, "make a little noise" so as to provide plenty of cooling in the enclosure and even an inexpensive home brew NAS can provide many years of service.</div></div><div class="elided-text"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jun 16, 2017 at 9:17 AM, Raj Wurttemberg <span dir="ltr"><<a href="mailto:rajaw@c64.us" target="_blank">rajaw@c64.us</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">That was my thought also... if the motherboard dies it will be a real pain<br>
in the backside. I don't have any benchmarks but I would imagine that the<br>
throughput on the RAID card would be faster than the motherboard SATA. Of<br>
course there is cost too. It seems that quite a few motherboards support six<br>
or more SATA connections. With FreeNAS and ZFS, that would make for a very<br>
inexpensive NAS.<br>
<span class="m_-1573259417063926162HOEnZb"><font color="#888888"><br>
/Raj<br>
</font></span><div class="m_-1573259417063926162HOEnZb"><div class="m_-1573259417063926162h5"><br>
-----Original Message-----<br>
From: <a href="mailto:ale-bounces@ale.org" target="_blank">ale-bounces@ale.org</a> [mailto:<a href="mailto:ale-bounces@ale.org" target="_blank">ale-bounces@ale.org</a>] On Behalf Of Jeff<br>
Hubbs<br>
Sent: Friday, June 16, 2017 12:50 AM<br>
To: <a href="mailto:ale@ale.org" target="_blank">ale@ale.org</a><br>
Subject: Re: [ale] NAS recommendations<br>
<br>
I still have my TO materials for the server I built and I had to consult<br>
them - it's been seven years. :)<br>
<br>
I used two 3ware SAS cards for the 14 faster/smaller drives and a 3ware SATA<br>
card for eight slower/bigger drives. The production shares were on the SAS<br>
drives and the SATA drives were for offlining and processing backups. All<br>
the 3ware cards were JBOD and mdraid handled everything.<br>
The Supermicro mobo had six SATA ports; two went to 80GB drives on the front<br>
panel that were used for swap and /var and two went to SSDs inside the case<br>
that held /boot, /auxboot/, and root in an RAID1. The SAS drives were paired<br>
off, one per controller, made into RAID1, then all seven of those pairs were<br>
made into a RAID0. The splitting was so that I could lose an entire SAS<br>
controller and the md volume would just keep on running.<br>
<br>
Using kernel raid and controllers in JBOD mode meant that if the primary<br>
machine's mobo *did* fry, I could just slam 22 disks from its front panel<br>
into the secondary, boot it up, change the IP address, and carry on.<br>
Pointy-hairs tend to want to only buy things with service contracts...well,<br>
I've seen many cases where the practical reality of having some tech figure<br>
out where your office is, row through traffic, and show up with a<br>
motherboard that turns out to be the wrong one so he has to go back to the<br>
shop, etc., etc. - once even server-grade hardware got commoditized and<br>
fairly well standardized, the DEC/HP/IBM/Sun/SGI/Dell way of dealing with<br>
breakage just didn't make sense. I know some people will go there anyway but<br>
my public-sector work ethic of committing to get the most value for the<br>
least money (later adding "under the least restrictive conditions" once I<br>
went Open Source) never left me.<br>
<br>
Oh, and I also stuffed a high-end dual gig-E NIC in a slot (bonded) and used<br>
that for production. Much like with the disk controllers, you want to avoid<br>
depending on mobo functions where you can; I'd much rather replace a<br>
lightning-fried NIC than a motherboard.<br>
<br>
On 6/15/17 10:21 PM, Raj Wurttemberg wrote:<br>
> For those of you using custom NAS boxes, are you using a PCI RAID<br>
> controller or are you using the motherboard SATA?<br>
><br>
> /Raj<br>
><br>
> ______________________________<wbr>_________________<br>
> Ale mailing list<br>
> <a href="mailto:Ale@ale.org" target="_blank">Ale@ale.org</a><br>
> <a href="http://mail.ale.org/mailman/listinfo/ale" rel="noreferrer" target="_blank">http://mail.ale.org/mailman/li<wbr>stinfo/ale</a><br>
> See JOBS, ANNOUNCE and SCHOOLS lists at<br>
> <a href="http://mail.ale.org/mailman/listinfo" rel="noreferrer" target="_blank">http://mail.ale.org/mailman/li<wbr>stinfo</a><br>
><br>
<br>
______________________________<wbr>_________________<br>
Ale mailing list<br>
<a href="mailto:Ale@ale.org" target="_blank">Ale@ale.org</a><br>
<a href="http://mail.ale.org/mailman/listinfo/ale" rel="noreferrer" target="_blank">http://mail.ale.org/mailman/li<wbr>stinfo/ale</a><br>
See JOBS, ANNOUNCE and SCHOOLS lists at<br>
<a href="http://mail.ale.org/mailman/listinfo" rel="noreferrer" target="_blank">http://mail.ale.org/mailman/li<wbr>stinfo</a><br>
<br>
______________________________<wbr>_________________<br>
Ale mailing list<br>
<a href="mailto:Ale@ale.org" target="_blank">Ale@ale.org</a><br>
<a href="http://mail.ale.org/mailman/listinfo/ale" rel="noreferrer" target="_blank">http://mail.ale.org/mailman/li<wbr>stinfo/ale</a><br>
See JOBS, ANNOUNCE and SCHOOLS lists at<br>
<a href="http://mail.ale.org/mailman/listinfo" rel="noreferrer" target="_blank">http://mail.ale.org/mailman/li<wbr>stinfo</a><br>
</div></div></blockquote></div><br></div>
</div><br>______________________________<wbr>_________________<br>
Ale mailing list<br>
<a href="mailto:Ale@ale.org">Ale@ale.org</a><br>
<a href="http://mail.ale.org/mailman/listinfo/ale" rel="noreferrer" target="_blank">http://mail.ale.org/mailman/<wbr>listinfo/ale</a><br>
See JOBS, ANNOUNCE and SCHOOLS lists at<br>
<a href="http://mail.ale.org/mailman/listinfo" rel="noreferrer" target="_blank">http://mail.ale.org/mailman/<wbr>listinfo</a><br>
<br></blockquote></div><br></div>