<html><head></head><body>+1 on encryption being the culprit. What cypher are you using. Some are extremely cpu intensive and highly sensitive to IO, block size, L2 cache size. Some are tunable to better fit your hardware.<br><br><div class="gmail_quote">On April 21, 2015 12:06:35 PM EDT, James Sumners <james.sumners@gmail.com> wrote:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div dir="ltr">What happens if you disable encryption in the backup?</div><div class="gmail_extra"><br /><div class="gmail_quote">On Tue, Apr 21, 2015 at 11:35 AM, Edward Holcroft <span dir="ltr"><<a href="mailto:eholcroft@mkainc.com" target="_blank">eholcroft@mkainc.com</a>></span> wrote:<br /><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-size:small">I am trying out Duplicity for backup to local USB. I used rsync before, but now we need to encrypt our backups.</div><div class="gmail_default" style="font-size:small"><br /></div><div class="gmail_default" style="font-size:small">The problem I am finding is that it's terribly slow. In the last 16 hours it's only backed up about 500GB. When I was using rsync, an initial full backup would take a bout 10 hours.</div><div class="gmail_default" style="font-size:small"><br /></div><div class="gmail_default"
style="font-size:small">Source is a RAID 5 partition with ext4 on CentOS 7 and destination is a SATA drive in a docking station connected with USB3, formatted as NTFS. It does not have to be NTFS, that's just a hangover from when this was a windows server.</div><div class="gmail_default" style="font-size:small"><br /></div><div class="gmail_default" style="font-size:small">I can actually see visually from the I/O activity LED on the USB drive that things are very slow, it blinks for a few seconds and then stops for several seconds. When I was using rsync, that LED would flicker all the time that the sync was taking place.</div><div class="gmail_default" style="font-size:small"><br /></div><div class="gmail_default" style="font-size:small">I thought maybe clamav was the casue of teh issue since it was hogging the CPU, but stopping that has made no difference.</div><div class="gmail_default" style="font-size:small"><br /></div><div class="gmail_default" style="font-size:sma
ll">Is
this normal for Duplicity?</div><div class="gmail_default" style="font-size:small"><br /></div><div class="gmail_default" style="font-size:small">cheers</div><div class="gmail_default" style="font-size:small">ed</div><span class="HOEnZb"><font color="#888888"></font><div><font color="#888888"><br /></font></div>-- <br /><div><div dir="ltr">Edward Holcroft | Madsen Kneppers & Associates Inc.<br />11695 Johns Creek Parkway, Suite 250 | Johns Creek, GA 30097<br />O <a href="tel:%28770%29%20446-9606" value="+17704469606" target="_blank">(770) 446-9606</a> | M <a href="tel:%28770%29%20630-0949" value="+17706300949" target="_blank">(770) 630-0949</a></div></div>
</span></div><span class="HOEnZb"><font color="#888888">
<br />
<span style="font-family:arial"><font size="2">MADSEN, KNEPPERS & ASSOCIATES USA, MKA Canada Inc. WARNING/CONFIDENTIALITY NOTICE: This message may be confidential and/or privileged. If you are not the intended recipient, please notify the sender immediately then delete it - you should not copy or use it for any purpose or disclose its content to any other person. Internet communications are not secure. You should scan this message and any attachments for viruses. Any unauthorized use or interception of this e-mail is illegal.</font></span></font></span><br />_______________________________________________<br />
Ale mailing list<br />
<a href="mailto:Ale@ale.org">Ale@ale.org</a><br />
<a href="http://mail.ale.org/mailman/listinfo/ale" target="_blank">http://mail.ale.org/mailman/listinfo/ale</a><br />
See JOBS, ANNOUNCE and SCHOOLS lists at<br />
<a href="http://mail.ale.org/mailman/listinfo" target="_blank">http://mail.ale.org/mailman/listinfo</a><br />
<br /></blockquote></div><br /><br clear="all" /><div><br /></div>-- <br /><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>James Sumners<br /><a href="http://james.sumners.info/" target="_blank">http://james.sumners.info/</a> (technical profile)</div><div><a href="http://jrfom.com/" target="_blank">http://jrfom.com/</a> (personal site)</div><div><a href="http://haplo.bandcamp.com/" target="_blank">http://haplo.bandcamp.com/</a> (band page)</div></div></div></div></div>
</div>
<p style="margin-top: 2.5em; margin-bottom: 1em; border-bottom: 1px solid #000"></p><pre class="k9mail"><hr /><br />Ale mailing list<br />Ale@ale.org<br /><a href="http://mail.ale.org/mailman/listinfo/ale">http://mail.ale.org/mailman/listinfo/ale</a><br />See JOBS, ANNOUNCE and SCHOOLS lists at<br /><a href="http://mail.ale.org/mailman/listinfo">http://mail.ale.org/mailman/listinfo</a><br /></pre></blockquote></div><br>
-- <br>
Sent from my Android device with K-9 Mail. Please excuse my brevity.</body></html>