HomeSoftware Heritage

Added RevisionMetadataIndexer with a detection tool for metadata

Description

Added RevisionMetadataIndexer with a detection tool for metadata

  • RevisionMetadataIndexer takes a list of revisions and detects

in the root directory all the file names supported by the
swh-metadata-detector version 0.0.1 that can contain metadata

  • checks if files where translated before in the content_metadata

table

  • if not: sends the files to indexation
  • aggregates results

Note: should keep results in revision_metadata but this part
is not ready in the storage

  • also, changed init of ContentMetadataIndexer with tool in args

Details

Provenance
moraneggAuthored on Jul 25 2017, 12:37 PM
moraneggPushed on Jul 28 2017, 12:45 PM
Differential Revision
D233: Added level of abstraction in indexers to use BaseIndexer for revisions
Parents
rDCIDX5fbcca11425c: Added level of abstraction in indexers to use BaseIndexer for revisions
Branches
Loading...
Tags
Loading...