[mirror-admin] Generating fullfilelist

[Dennis Gilmore]

On Tuesday, March 29, 2016 12:57:09 PM CDT Stephen John Smoogen wrote:
> Starting off, I would like to thank Carlos from inf.ufpr.br for
> bringing this file up. It isn't one I generate because it is in the
> build system. It is currently created as part of the push with the
> following script:
> 
> https://infrastructure.fedoraproject.org/cgit/ansible.git/tree/roles/releng/
> files/update-fullfilelist
> 
> https://infrastructure.fedoraproject.org/cgit/ansible.git/tree/roles/bodhi2/
> backend/files/update-fullfilelist
> 
> currently fullfilelist gets generated in several areas via a find *
> command and has the format of:
> 
> 
> fedora
> fedora/linux
> 
> if we use a rsync and put the the file format would be:
> 
> ==> good-fullfilelist <==
> drwxr-xr-x        4096 2015/08/20 01:15:38 .
> -rw-r--r--     1273297 2016/03/28 22:46:34 DIRECTORY_SIZES.txt
> drwxr-xr-x        4096 2016/02/25 01:54:43 alt
> drwxrwxr-x        4096 2016/01/29 20:58:53 alt/anaconda
> -rw-r--r--   486539264 2016/01/29 21:05:07
> alt/anaconda/rawhide-docker-2-boot.iso
> -rw-r--r--   488636416 2016/01/21 22:41:23
> alt/anaconda/rawhide-docker-boot.iso -rw-rw-r--          90 2016/01/21
> 22:48:33
> alt/anaconda/rawhide-docker-boot.iso.sha256
> drwxrwsr-x        4096 2015/10/02 18:25:17 alt/atomic
> drwxrwsr-x        4096 2016/01/27 17:46:45 alt/atomic/stable
> drwxrwsr-x        4096 2016/03/08 19:23:15 alt/atomic/stable/Cloud-Images
> 
> I can then cut -c44- good-fullfilelist > fullfilelist to get a similar
> output as the 'find *' however it won't exactly be the same and I want
> to get an idea of who this will break?


The big issue that you hit with using the filelist to take advantage of only 
getting changed content is that it does not take advantage of hardlinking. 
something we make extensive use of. 

Dennis
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: This is a digitally signed message part.
URL: <http://mail.ale.org/pipermail/mirror-admin/attachments/20160419/f4822ace/attachment.sig>
-------------- next part --------------
--