Page MenuHomeSoftware Heritage

Add Luigi workflow in swh-dataset
Open, HighPublic

Description

It should:

  • export files to the local disk
  • upload to S3
  • define Athena tables