Page MenuHomeSoftware Heritage

completely move initial github mirror from uffizi to banco
Closed, MigratedEdits Locked

Description

Among other things, this will help liberating disk space on uffizi, where we're currently archiving the packfiles corresponding to every git-based loading we do.

The transfer had already been started by @ardumont a while ago, but is not complete yet.

Event Timeline

started in a screen session of my user on uffizi

zack renamed this task from move initial github mirror from uffizi to banco to completely move initial github mirror from uffizi to banco.Jul 26 2016, 7:13 PM
zack updated the task description. (Show Details)
zack added a subscriber: ardumont.
zack changed the task status from Open to Work in Progress.Jul 27 2016, 9:26 AM

It took about 4 days to rsync the letter b, and I've only now started removing it from disk.
As babysitting this process is no fun, I've automated it to completion.

The screen named "github-mirror-move" and running as my user on uffizi has two windows:

  • one is running the rsync of all remaining first letters to banco, one by one. At the end of each letter the dir get moved to the ready-to-be-delete queue
  • another is looping on the content of the queue (with a 1-hour sleep if nothing has to be done), and removing all dirs it found there

At the current rate rate, it should take about 50 days to transfer everything.