HomeSoftware Heritage

Check archive length before uncompress step

Description

Check archive length before uncompress step

Some small number of archives are incomplete, thus the check failed.
As we approach the googlecode deadline, the code is now:

  • In case of check failure, check the archive's size match with the metadata.
  • If mismatch, fetch the archive again and recheck.
  • If failure, log it as failure.

Details

Provenance
ardumontAuthored on May 11 2016, 9:57 AM
ardumontPushed on May 12 2016, 2:59 PM
Parents
R61:9a428e0f2b90: Be also defensive against file with extensions not in (gz, zip)
Branches
Unknown
Tags
Unknown