[ale] Performance issue
DJ-Pfulio
DJPfulio at jdpfu.com
Sat Aug 20 20:38:48 EDT 2016
Bus specifications have little to do with spinning disk performance, as
you know.
What is the max for each drive to read? 120-180Mbps? How are the
arrays striped? 4-way, 8-way? That would mean at 4 x 120Mbps (480Mbps)
is the highest possible throughput I'd expect. 960Mbps if 8-way stripe
... there is overhead ... so 800Mbps seems reasonable to me.
http://wintelguy.com/raidperf.pl is more pessimistic on performance. I'm
not convinced this numbers are MB/s. Think they are Mb/s.
On 08/20/2016 06:49 PM, Ted W. wrote:
> If you didn't already, try either iostat as `iostat -xm 1` or `sar -d`.
> You see any unusual await or anything else that sticks out?
>
> What FS? LVM?
>
> A shot in the dark might lead me to check the FS alignment with fdisk but that
> seems like an awfully large performance hit for something like that.
>
> -Ted
>
> On Fri, Aug 19, 2016 at 10:26:22AM -0400, Jim Kinney wrote:
>> Getting DISMAL performance from new hardware.
>>
>> Twin 6-core Xeon E5-2630L v.2 @2.40 GHz
>> 128GB DDR4 RAM
>> LSI megaraid 2108 in a PCIe v3 slot
>> Onboard LSI 3108
>> Drives are all 6Gbps SAS2 4TB
>> 2 arrays, RAID 6, one is 40Tb, other 104TB
>>
>> Everything hardware says I should expect a minimum through put of
>> 12Gbps on either array.
>>
>> The max I'm getting from iotop is 784 Mbps.
>>
>> W. T. F!!!
>>
>> According to top, the system is basically idle. Ditto from iostat and
>> every other tool I check. I'm doing a 'cp -a' from/to same array.
>>
>> Yes. New location is Luks encrypted. That process is totally asleep
>> it's getting so little work. The rng is busy (dev/random is not running
>> out (watch -n 1 cat /proc/sys/kernel/random/entropy_avail was always
>> above 2048)) but not overloaded or asleep.
>>
>> Tested going unencrypted to unencrypted with similar performance.
>>
>> Changed tuned-adm to latency-performance from balanced and the read
>> portion of the cp went to 0 bps for 20 seconds until I switched it back
>> to balanced mode. So that was a fail. It improved greatly using
>> throughout-performance mode (bursts of 250MB/s) but was still showing
>> long periods of 0 writes. Load went up from a paltry 8 to 22 so it's
>> working more.
>>
>> But top shows wa values across multiple cores hitting 100 so it's
>> hitting a wall somewhere.
>>
>> Any ideas of more places to look?
>
>> _______________________________________________
>> Ale mailing list
>> Ale at ale.org
>> http://mail.ale.org/mailman/listinfo/ale
>> See JOBS, ANNOUNCE and SCHOOLS lists at
>> http://mail.ale.org/mailman/listinfo
>
> _______________________________________________
> Ale mailing list
> Ale at ale.org
> http://mail.ale.org/mailman/listinfo/ale
> See JOBS, ANNOUNCE and SCHOOLS lists at
> http://mail.ale.org/mailman/listinfo
>
--
Got Linux? Used on smartphones, tablets, desktop computers, media
centers, and servers by kids, Moms, Dads, grandparents and IT
professionals.
More information about the Ale
mailing list