[mirror-admin] Fedora mirror disk usage

[Stephen John Smoogen]

On 28 March 2016 at 18:21, Carlos <carlos at inf.ufpr.br> wrote:
> Stephen John Smoogen (smooge at gmail.com) wrote on Sun, Mar 20, 2016 at 05:17:13PM
>  BRT:
>> On 20 March 2016 at 06:48, Ján ONDREJ (SAL) <ondrejj at salstar.sk> wrote:
>> > Hello,
>> >
>> >   looks like Fedora's download content is daily increasing.
>> > I removed some non Fedora data from my mirror, but looks like it's still not
>> > enough. Currently development content is more than 1 TB of data.
>> > Is this normal? How many disk space is required to mirror Fedora?
>> >
>> > [root at ftp]# du -sh /home/ftp/pub/fedora/linux/development/*
>> > 675G    /home/ftp/pub/fedora/linux/development/rawhide
>> > 542G    /home/ftp/pub/fedora/linux/development/24
>> >
>>
>> SO that doesn't match up with our side:
>> 244G    /pub/fedora/linux/development/rawhide
>> 255G    /pub/fedora/linux/development/24
>>
>> I just double checked on our mirror of that data and it is showing the
>> same amount. Even when removing all hardlinks it comes out as
>>
>> 393G    ./24
>> 377G    ./rawhide/
>>
>> so I think you have something else going on your mirror.
>
> There was indeed a jump on the repository size. Now it takes here 1.7TB and
> around 2 million files... The increase happened with the addition of the
> development branch. It has a clear impact on mirror updates because
> dl.fedoraproject.org is much more loaded.
>
> --

However there isn't a jump of 600 GB as the user was seeing. I will be
copying 21 over to archive this week. After that is done I will wait a
week and then remove from /pub/fedora/linux That will cut down 200 GB
of the main site. The rest I am not sure what to do about.. people
keep wanting more spins and images

-- 
Stephen J Smoogen.

--