[mirror-admin] Fastest way to copy data between two servers?

[Mike Grant]

On 22/11/11 16:25, James Peltier wrote:
> Tar over a netcat pipe is very fast and I use it all the time

Agreed, this is what we use for multi-TB transfers.  On our (baby)
network, we get around 35MB/s for a straight NFS cp, maybe 40 for an
rsync over ssh, but about 70MB/s for tar+nc.  While these numbers will
vary for you, hopefully the ratios will be similar.

If it crashes, we either re-run the tar+nc or fill in the gaps with an
rsync, depending on how much got transferred over.

Cheers,

Mike.

--------------------------------------------------------------------------------
Plymouth Marine Laboratory
 
Registered Office:
Prospect Place 
The Hoe
Plymouth  PL1 3DH
 
Website: www.pml.ac.uk
Click here for PML Annual Review
Registered Charity No. 1091222
PML is a company limited by guarantee
registered in England & Wales
company number 4178503

Please think before you print

--------------------------------------------------------------------------------
This e-mail, its content and any file attachments are confidential.

If you have received this e-mail in error please do not copy, disclose it to any third party or use the contents or attachments in any way. Please notify the sender by replying to this e-mail or e-mail forinfo at pml.ac.uk and then delete the email without making any copies or using it in any other way.

The content of this message may contain personal views which are not the views of Plymouth Marine Laboratory unless specifically stated.

You are reminded that e-mail communications are not secure and may contain viruses. Plymouth Marine Laboratory accepts no liability for any loss or damage which may be caused by viruses.
--------------------------------------------------------------------------------

--