[mirror-admin] Fastest way to copy data between two servers?

James Peltier jpeltier at sfu.ca
Tue Nov 22 11:25:25 EST 2011


Tar over a netcat pipe is very fast and I use it all the time

--
James A. Peltier
IT Services - Research Computing Group
Simon Fraser University


On 2011-11-22, at 8:18 AM, Scott Baker <bakers at canbytel.com> wrote:

> My old Fedora mirror is going to be retired and replaced newer hardware.
> I need to copy data between the two and I'm wondering what the fastest
> way is going to be? Usually I'd just rsync + SSH between them but that's
> probably not the most efficient for 3TB of data. Then I started
> thinking, what if I NFS mounted the old one and used rsync + NFS instead.
> 
> I suppose the absolute fastest would NFS + "cp -a"?  That doesn't give
> me any recovery if it crashes. The transfer is going to take a long
> time, so I'm pretty sure I want rsync for recoverability. Any
> suggestions on best practices to move a large amount of data like this?
> 
> -- 
> Scott Baker - Canby Telcom
> System Administrator - RHCE - 503.266.8253
> 
> --

--


More information about the Mirror-admin mailing list