<div dir="ltr"><div class="gmail_default" style="font-size:small">I tested this on my production box with all the identical pieces of kit. A full rsync of the 1.5 TB or so of data on this server takes maybe 10 -11 hours. A full backup using Duplicity to the same USB drive on the same server was less than half that - I gave up on 26% after some 16 hours. I'd expect some added overhead for the encrypting and tarring that's going on, but this is nuts. I have to be doign something wrong or nobody would be using duplicity. Here's the command I use, which is pretty stock as far as I know:</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default">duplicity /data --exclude /data/ret --exclude /data/rsynclogs file:///mnt/daily/MONDAY >> /data/rsynclogs/daily-`date +%Y%m%d_%H%M%S`.log<br></div><div class="gmail_default"><br></div><div class="gmail_default">I also tried with --no-encyrption and dropped the logging with no noticeable difference.</div><div class="gmail_default"><br></div><div class="gmail_default">ed</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Apr 21, 2015 at 9:07 PM, James Sumners <span dir="ltr"><<a href="mailto:james.sumners@gmail.com" target="_blank">james.sumners@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><span class=""><br><div class="gmail_quote">On Tue, Apr 21, 2015 at 8:00 PM, Edward Holcroft <span dir="ltr"><<a href="mailto:eholcroft@mkainc.com" target="_blank">eholcroft@mkainc.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div class="gmail_default" style="font-size:small">Nice, thanks James. If I can get it to run faster, I may use this.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">ed</div></blockquote></div><br></span>Er, the time estimate was a bit off. I forgot that the system I was quoting uses multiple partitions and the "<span style="color:rgb(80,0,80);font-size:12.8000001907349px">--exclude-other-filesystems" switch skips those. Still, it doesn't take hours to run.</span></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px"><br></span></font></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px">I think your issue is down to the USB stack. Check the following:</span></font></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px"><br></span></font></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px">1) You are really plugged into a USB 3 port</span></font></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px">2) You are using a USB 3 cable</span></font></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px">3) Your caddy really supports USB 3 speeds[1]</span></font></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px">4) Your kernel supports USB 3</span></font></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px">5) Your kernel's USB 3 support is enabled</span></font></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px">6) Ditto for the BIOS</span></font></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px"><br></span></font></div><div class="gmail_extra"><font color="#500050"><span style="font-size:12.8000001907349px">[1] -- <a href="https://en.wikipedia.org/wiki/USB_3.0#Speed_and_compatibility" target="_blank">https://en.wikipedia.org/wiki/USB_3.0#Speed_and_compatibility</a></span><br></font><span class=""><br clear="all"><div><br></div>-- <br><div><div dir="ltr"><div><div dir="ltr"><div>James Sumners<br><a href="http://james.sumners.info/" target="_blank">http://james.sumners.info/</a> (technical profile)</div><div><a href="http://jrfom.com/" target="_blank">http://jrfom.com/</a> (personal site)</div><div><a href="http://haplo.bandcamp.com/" target="_blank">http://haplo.bandcamp.com/</a> (band page)</div></div></div></div></div>
</span></div></div>
<br>_______________________________________________<br>
Ale mailing list<br>
<a href="mailto:Ale@ale.org">Ale@ale.org</a><br>
<a href="http://mail.ale.org/mailman/listinfo/ale" target="_blank">http://mail.ale.org/mailman/listinfo/ale</a><br>
See JOBS, ANNOUNCE and SCHOOLS lists at<br>
<a href="http://mail.ale.org/mailman/listinfo" target="_blank">http://mail.ale.org/mailman/listinfo</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr">Edward Holcroft | Madsen Kneppers & Associates Inc.<br>11695 Johns Creek Parkway, Suite 250 | Johns Creek, GA 30097<br>O (770) 446-9606 | M (770) 630-0949</div></div>
</div>
<br>
<span style="font-family:arial"><font size="2">MADSEN, KNEPPERS & ASSOCIATES USA, MKA Canada Inc. WARNING/CONFIDENTIALITY NOTICE: This message may be confidential and/or privileged. If you are not the intended recipient, please notify the sender immediately then delete it - you should not copy or use it for any purpose or disclose its content to any other person. Internet communications are not secure. You should scan this message and any attachments for viruses. Any unauthorized use or interception of this e-mail is illegal.</font></span>