[ale] Duplicity very slow

[Jim Kinney]

+1 on encryption being the culprit. What cypher are you using. Some are extremely cpu intensive and highly sensitive to IO, block size, L2 cache size. Some are tunable to better fit your hardware.

On April 21, 2015 12:06:35 PM EDT, James Sumners <james.sumners at gmail.com> wrote:
>What happens if you disable encryption in the backup?
>
>On Tue, Apr 21, 2015 at 11:35 AM, Edward Holcroft
><eholcroft at mkainc.com>
>wrote:
>
>> I am trying out Duplicity for backup to local USB. I used rsync
>before,
>> but now we need to encrypt our backups.
>>
>> The problem I am finding is that it's terribly slow. In the last 16
>hours
>> it's only backed up about 500GB. When I was using rsync, an initial
>full
>> backup would take a bout 10 hours.
>>
>> Source is a RAID 5 partition with ext4 on CentOS 7 and destination is
>a
>> SATA drive in a docking station connected with USB3, formatted as
>NTFS. It
>> does not have to be NTFS, that's just a hangover from when this was a
>> windows server.
>>
>> I can actually see visually from the I/O activity LED on the USB
>drive
>> that things are very slow, it blinks for a few seconds and then stops
>for
>> several seconds. When I was using rsync, that LED would flicker all
>the
>> time that the sync was taking place.
>>
>> I thought maybe clamav was the casue of teh issue since it was
>hogging the
>> CPU, but stopping that has made no difference.
>>
>> Is this normal for Duplicity?
>>
>> cheers
>> ed
>>
>> --
>> Edward Holcroft | Madsen Kneppers & Associates Inc.
>> 11695 Johns Creek Parkway, Suite 250 | Johns Creek, GA 30097
>> O (770) 446-9606 | M (770) 630-0949
>>
>> MADSEN, KNEPPERS & ASSOCIATES USA, MKA Canada Inc.
>WARNING/CONFIDENTIALITY
>> NOTICE: This message may be confidential and/or privileged. If you
>are not
>> the intended recipient, please notify the sender immediately then
>delete it
>> - you should not copy or use it for any purpose or disclose its
>content to
>> any other person. Internet communications are not secure. You should
>scan
>> this message and any attachments for viruses. Any unauthorized use or
>> interception of this e-mail is illegal.
>> _______________________________________________
>> Ale mailing list
>> Ale at ale.org
>> http://mail.ale.org/mailman/listinfo/ale
>> See JOBS, ANNOUNCE and SCHOOLS lists at
>> http://mail.ale.org/mailman/listinfo
>>
>>
>
>
>-- 
>James Sumners
>http://james.sumners.info/ (technical profile)
>http://jrfom.com/ (personal site)
>http://haplo.bandcamp.com/ (band page)
>
>
>------------------------------------------------------------------------
>
>_______________________________________________
>Ale mailing list
>Ale at ale.org
>http://mail.ale.org/mailman/listinfo/ale
>See JOBS, ANNOUNCE and SCHOOLS lists at
>http://mail.ale.org/mailman/listinfo

-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.ale.org/pipermail/ale/attachments/20150421/48fad1ec/attachment.html>