[mirror-admin] Large amount of content removed - issue with master mirror or quick-fedora-mirror script?

[HEAnet Mirror Admin]

Hello all,

I noticed our fedora mirror was practically emptied on Thursday
morning, it's resynced now but I'm trying to figure out why everything
was deleted in order to avoid any future occurances.

The mass deletion (1733969 files and 6544 directories) happened during a
sync that started around 04:23 (GMT) Thursday morning.

We have been using quick-fedora-mirror* for a while now, and this is the
first time this has happened. quick-fedora-mirror works really well
and makes our syncs much faster, I'd like to keep using it so I'm
looking to determine if this was a SNAFU with the quick-fedora-mirror
script itself, the master site at dl.fedoraproject.org or some
combination of both? Or mabye something in our own setup?

As far as I can tell, when quick-fedora-mirror ran, it determined that
we had 1733969 files and 6544 directories that weren't present on
dl.fedoraproject.org and as such were marked for deletion.
quick-fedora-mirror determines this based on the contents of
fullfilelist as far as I can see. So perhaps we caught it mid-update?
Is it possible for this file to be empty for a brief period?

Unfortunately the temporary data that quick-fedora-mirror generates is
gone, but I do have a detailed log file that I can send on if required.

 * https://pagure.io/quick-fedora-mirror

Thanks!

rg

-- 
Rob Gallagher | Public Key: 0x841386E3

HEAnet Limited, Ireland's Education and Research Network
1st Floor, 5 George's Dock, IFSC, Dublin D01 X8N7
Registered in Ireland, no 275301
☎  (+353-1) 6609040 WWW: http://www.heanet.ie/


--