HomeSoftware Heritage

compression: upgrade to work with *very* large datasets

Description

compression: upgrade to work with *very* large datasets

  • Switch from BFS to BFSBig
  • Add '--temp-dir' flag to avoid running out of space in /tmp/
  • Specify batch size to prevent too many open files

Details

Provenance
haltodeAuthored on Jun 6 2019, 2:01 PM
haltodePushed on Jun 6 2019, 2:03 PM
Parents
rDGRPH5095dcdb74d0: reports: add hard-coded dates for chronology
Branches
Unknown
Tags
Unknown