HomeSoftware Heritage

luigi: Add LocalExport task

Description

luigi: Add LocalExport task

It allows other packages (eg. swh-graph) to depend on the presence of the local
dataset, with a configurable way to obtain it if missing

Details

Provenance
vlorentzAuthored on Nov 21 2022, 3:47 PM
vlorentzPushed on Nov 24 2022, 4:12 PM
Differential Revision
D8865: luigi: Add LocalExport task
Parents
rDDATASETb39436e38be5: luigi: Remove copies of stamp files to/from S3
Branches
Unknown
Tags
Unknown
Build Status
Buildable 32963
Build 51664: test-and-buildJenkins console · Jenkins