[mirror-admin] Removal of files from /pub/fedora/linux

[Stephen John Smoogen]

I apologize for the late notice and thank you to Carlos of ufpr.br for
catching this

1. Fedora Atomic has been moved out of the /pub/fedora/linux domain
and is now going through the koji squid proxies. The reason for this
was multiple:
  a. the ostree tool isn't aware of mirrormanager and the work to do
so was taking longer than expected so mirrors carrying this were not
seeing usage from people unless they hard coded to use a particular
mirror.
  b. ostree is a git based file system. Thus the number of objects in
it grows as more and more packages are updated. This has bonuses for
the devop who wants to rollback/forward various packages but it also
is very rsync bad as every file in the tree has to be stat() when the
demon checks what files have been updated. It took time to go over
900,000 files which took up 95% of a rsync of the fedora-enchilada.
That should be most of the 1.1 million objects you saw removed. [The
overall size of this wasn't too much about 250 GB for 21->rawhide
trees]

2. Fedora 21 was archived and removed from /pub/fedora/linux. These
files had been hardlinked with the /pub/archive/fedora/linux/ for the
last 3 weeks so when I removed them from fedora-enchilada there would
be drop in number of objects but not much in size.

These should have a positive impact on rsync performance of the
fedora-buffet tree.. though we are not sure how much yet as we are
dealing with some other issues also.

Current tree sizes:
1.4T    /pub/alt/
6.5T    /pub/archive/
1.9T    /pub/fedora-secondary/
1.4T    /pub/fedora/
140G    /pub/epel/



-- 
Stephen J Smoogen.

--