[mirror-admin] kernel.org refusing rsync

[J.H.]

Carlos Carvalho wrote:
> Ricky Zhou (ricky at fedoraproject.org) wrote on 20 July 2009 12:50:
>  >On 2009-07-20 01:26:19 PM, Carlos Carvalho wrote:
>  >> rsync: read error: Connection reset by peer (104)
>  >> 
>  >> Also, since about midnight UTC updates seem to have stopped. What's happening?
>  >Hi, which kernel.org server are you pulling from?  I think
>  >mirrors.kernel.org is a round robin for mirrors[1-4].kernel.org

This would be because mirrors[12] are getting *HAMMERED* again.  I'm not 
sure who is all using us as upstream but we have been getting hammered, 
hard, for the last few days.  Our rsync will completely cut off access 
if the load is above 150 on a box, which it has been getting to fairly 
regularly lately.

> 
> Yes, I use mirrors1. Cannot use 3-4 because they're in Europe.
> 
>  >For what it's worth, I am able to connect to rsync on all of those.
> 
> It's now accepted the connection but it's been more than one hour and
> still no filelist :-(

Well when the load on the mirrors in the US is in the 40-50+ range (and 
spiking well over 100 regularly), yeah things are going to be slow. 
Please keep in mind, when I say load that is a direct correlation of how 
hammered our disks are, since our CPUs have a tendency to sit at idle 
and the load is reflecting how many processes are sitting in D state 
waiting on disk.

You can try flipping over to mirrors2 (mirrors1 seems to be more 
hammered).  Heck even flipping over to the machines in Europe might not 
be a bad idea, their disk is much newer, they have more memory and their 
loads are *MUCH MUCH* lower.  But really, the US machines are 5year old 
hardware and I seem to be running nearly 1 full point of load per rsync 
right now that's active on the box.  If your running checksum, stop for 
now - it's hurting *HARD*.  If your doing something like syncing from me 
more than 4 times a day, cut it back for now - there are too many people 
trying to get data from me.

If you want to watch 'play-by-play' you can go to 
http://cacit.kernel.org/graph_view.php and look under loads, the 'zeus' 
class machines are the mirror machines in question.

- John 'Warthog9' Hawley

--