Diffusion Datasets c717f60fe08e

luigi.RunExportAll: Default to exporting all formats
c717f60fe08e
Actions

Tags

None

Subscribers

None

Description

luigi.RunExportAll: Default to exporting all formats

Details

Provenance

vlorentz	Authored on Dec 6 2022, 2:02 PM
vlorentz	Pushed on Dec 7 2022, 10:02 AM

Differential Revision

D8926: luigi.RunExportAll: Default to exporting all formats

Parents

rDDATASETeceaf73f0fba: luigi.CreateAthena: Fix validation of DB name

Branches

Unknown

Tags

Unknown

References

Tasks

T4676: Add Luigi workflow in swh-dataset

Build Status

Buildable 33110
Build 51901: test-and-build	Jenkins console · Jenkins

Event Timeline

vlorentz committed rDDATASETc717f60fe08e: luigi.RunExportAll: Default to exporting all formats (authored by vlorentz).Dec 6 2022, 2:02 PM

vlorentz added a task: T4676: Add Luigi workflow in swh-dataset.Dec 7 2022, 10:03 AM

vlorentz added an edge: D8926: luigi.RunExportAll: Default to exporting all formats.

Harbormaster completed building B33110: rDDATASETc717f60fe08e: luigi.RunExportAll: Default to exporting all formats.Dec 7 2022, 10:05 AM

swh-public-ci mentioned this in D8963: luigi: Read meta/export.json instead of relying on stamp files.Dec 16 2022, 3:12 PM

swh-public-ci mentioned this in D8965: luigi: Dynamically list directories instead of using object_types.Dec 16 2022, 3:40 PM

swh-public-ci mentioned this in D8966: luigi.UploadExportToS3: Skip upload of already-uploaded files.

Changes (1)

Path

Size

swh/

dataset/

rDDATASETc717f60fe08e

swh/dataset/luigi.py

Loading...