Page MenuHomeSoftware Heritage

Make the docker image extract and publish the export.fld directly
ClosedPublic

Authored by ardumont on Apr 5 2022, 6:53 PM.

Details

Summary

The export.fld file is the interesting result of this repository for one maven index.
With this new commit, running the image will compute and expose directly that result to
be published.

Prior to this commit, the docker image was only in charge of triggering the
extract_index.sh script. The python script was the orchestrator in charge of downloading
indexes, run the docker image and out of the index files retrieved, extract the
resulting export.fld script.

Example use:

$ docker volume create maven_index_exporter
$ docker run \
       -v maven_index_exporter:/work \
       -v /tmp/maven_index_exporter:/publish \
       softwareheritage/maven-index-exporter
$ file /tmp/maven_index_exporter/export.fld  # on the machine running docker
/tmp/maven_index_exporter/export.fld: UTF-8 Unicode text, with very long lines

Tests updated in the next diff D7509

Related to T3746

Diff Detail

Repository
rDLSMAVEXP maven-index-exporter
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

ardumont retitled this revision from Make the image download, extract and publish the export.fld directly to Make the docker image extract and publish the export.fld directly.Apr 6 2022, 9:39 AM
ardumont edited the summary of this revision. (Show Details)
This revision is now accepted and ready to land.Apr 6 2022, 11:42 AM