HomeSoftware Heritage

luigi: Remove copies of stamp files to/from S3

Description

luigi: Remove copies of stamp files to/from S3

They are only useful while exporting the dataset -- after the export is
finished, meta.json is good enough and stamp files only save a couple
of minutes when only some objects types are needed (ie. never in practice)

Details

Provenance
vlorentzAuthored on Nov 21 2022, 3:42 PM
vlorentzPushed on Nov 24 2022, 4:12 PM
Differential Revision
D8864: luigi: Remove copies of stamp files to/from S3
Parents
rDDATASET23853dbfacd4: luigi: Add DownloadFromS3 task
Branches
Unknown
Tags
Unknown
Build Status
Buildable 32961
Build 51662: test-and-buildJenkins console · Jenkins