<p dir="ltr">Getting DISMAL performance from new hardware.</p>
<p dir="ltr">Twin 6-core Xeon E5-2630L v.2 @2.40 GHz<br>
128GB DDR4 RAM<br>
LSI megaraid 2108 in a PCIe v3 slot<br>
Onboard LSI 3108<br>
Drives are all 6Gbps SAS2 4TB<br>
2 arrays, RAID 6, one is 40Tb, other 104TB</p>
<p dir="ltr">Everything hardware says I should expect a minimum through put of 12Gbps on either array.</p>
<p dir="ltr">The max I'm getting from iotop is 784 Mbps.</p>
<p dir="ltr">W. T. F!!!</p>
<p dir="ltr">According to top, the system is basically idle. Ditto from iostat and every other tool I check. I'm doing a 'cp -a' from/to same array. </p>
<p dir="ltr">Yes. New location is Luks encrypted. That process is totally asleep it's getting so little work. The rng is busy (dev/random is not running out (watch -n 1 cat /proc/sys/kernel/random/entropy_avail was always above 2048)) but not overloaded or asleep.</p>
<p dir="ltr">Tested going unencrypted to unencrypted with similar performance. </p>
<p dir="ltr">Changed tuned-adm to latency-performance from balanced and the read portion of the cp went to 0 bps for 20 seconds until I switched it back to balanced mode. So that was a fail. It improved greatly using throughout-performance mode (bursts of 250MB/s) but was still showing long periods of 0 writes. Load went up from a paltry 8 to 22 so it's working more.</p>
<p dir="ltr">But top shows wa values across multiple cores hitting 100 so it's hitting a wall somewhere.</p>
<p dir="ltr">Any ideas of more places to look?</p>