[ale] rsync comparisons

Jeff Hubbs jhubbslist at att.net
Thu Apr 1 15:55:15 EDT 2010


Is this a box-to-same-box rsync?

On 4/1/10 3:29 PM, Robert Coggins wrote:
> I am using -a --delete and --eclude.  Pretty Basic.
>
> To be honest I think my problem is with the Source.  It even does an ls
> very slow.  There are probably more than 1 million files in this 20GB.
>
> On 04/01/2010 02:49 PM, Björn Gustafsson wrote:
>    
>> Which switches are you using now?  It doesn't sound like adding the
>> ones discussed so far will help.
>>
>> On Thu, Apr 1, 2010 at 11:41 AM, Robert Coggins<ale at cogginsnet.com>  wrote:
>>      
>>> Well, what I a seeing is the syncing of roughly 20GB taking over an hour
>>> for just a few megs of differences.  It stays in the "building file
>>> list..." for almost all of this time.  I am trying to find a way to
>>> speed that up.
>>>
>>> Rob
>>>
>>> On 04/01/2010 11:37 AM, scott wrote:
>>>        
>>>> rsync compares on a file level BUT it compares timedate stamps/sizes
>>>> in "quick mode" (which is default).  but if you want it to compare
>>>> file to file, use "-c or --checksum" option.  Now this puts a heavier
>>>> load on both systems, since it does a MD5 checksum on every file that
>>>> has the same timedate stamp/size on both sides of the sync.  Now if
>>>> you want to force the copy of the whole file instead of the changed
>>>> blocks, use the --whole-file option with it.
>>>>
>>>> I would use this ( -c&  --whole-file) sparingly.  It is going to slow
>>>> down the copies, put heavier loads on both ends and transfer more data
>>>> (control data) back and forth.  I dont know your situation so I cant
>>>> say to use it or or not.
>>>>
>>>> scott
>>>>
>>>>
>>>> On Thu, Apr 1, 2010 at 11:00 AM, Robert Coggins<ale at cogginsnet.com>  wrote:
>>>>          
>>>>> Is there a way to do file level comparisons and not block level
>>>>> comparisons using rsync?
>>>>>
>>>>> Rob
>>>>>            
>>      
> _______________________________________________
> Ale mailing list
> Ale at ale.org
> http://mail.ale.org/mailman/listinfo/ale
> See JOBS, ANNOUNCE and SCHOOLS lists at
> http://mail.ale.org/mailman/listinfo
>
>    



More information about the Ale mailing list