Page MenuHomeSoftware Heritage
Create Task
Maniphest T596

Add license indexer
Closed, MigratedEdits Locked
Actions

Description

Possible tools:

  • ninka
  • nomos (fossology)

Related Objects
Search...

Event Timeline

ardumont created this task.Nov 4 2016, 2:19 PM
ardumont mentioned this in rDSNIP09923374e0f3: Add basic listing of nomos licenses from code.Nov 9 2016, 11:40 PM
ardumont mentioned this in rDSTO2fffbd4a77ea: storage: Add license and content_license tables.Nov 10 2016, 5:34 PM
ardumont mentioned this in rDSTOa63cbc78c9dc: storage: Open content_license endpoint (add/get).
ardumont mentioned this in rDSTO3dd9b0f36b6a: storage: Return unknown licenses.
ardumont mentioned this in rDSTO75280337f616: Update known licenses from fossology's master branch.
ardumont mentioned this in rDSTO9a079c5be4f5: storage: Update fossology_license to latest design.
ardumont mentioned this in rDCIDX6a0b882b04b2: Add ContentLicenseIndexer task.
ardumont mentioned this in rDCIDXda58ee9dadd5: Add license indexer.
ardumont mentioned this in rDCIDXf0bb41dbb181: license: Add endpoint api call to storage.
ardumont mentioned this in rDCIDX0c5d9fd608e9: license: Add endpoint api call to storage.
ardumont mentioned this in rDCIDX602cbe041b7d: license: Rename license to fossology_license.Nov 14 2016, 4:54 PM
ardumont mentioned this in rDCIDX5333e4925bc5: license: Fix some configuration labels + decrease verbosity.
ardumont mentioned this in rDCIDX2c192c588ec3: d/control: Update runtime dependency on fossology-nomossa.Nov 15 2016, 2:47 PM
ardumont mentioned this in rSPPROF6039318a40c6: swh::deploy::worker::swh_indexer_fossology_license: Add manifest.
ardumont mentioned this in rSPSITE8628765dbc67: data/defaults.yml: Add data for fossology license indexer.Nov 15 2016, 3:14 PM
ardumont mentioned this in rSPSITE61cdb51357aa: worker0*.euwest: Add license indexer on azure nodes.Nov 15 2016, 3:25 PM
ardumont mentioned this in rSPSITE969f01d4fd2f: data/defaults.yaml: Decrease fossology license indexer concurrency.
ardumont mentioned this in rSPSITEc7d8cfdaa988: data/defaults.yaml: Decrease mimetype indexer concurrency.
ardumont mentioned this in rSPPROFdd8a5eb4707a: swh::deploy::indexer: Upgrade indexer package when available.Nov 15 2016, 4:03 PM
ardumont changed the task status from Open to Work in Progress.Nov 15 2016, 4:31 PM
ardumont added a comment.EditedNov 15 2016, 4:37 PM

Sum up and status:

  • Use of fossology's nomossa (nomos standalone version)
  • DB schema updated (swh-storage)
  • Api endpoints opened to add/read nomos's output (swh-storage)
  • New Indexer added (swh-indexer)
  • Puppet manifest for that indexer (swh-profile, swh-site)
  • Deploy DB upgrade (uffizi)
  • Deploy swh-storage upgrade (uffizi)
  • Deploy indexer on azure nodes
  • Feed existing contents stored in azure to keep up with other indexers
  • Update missing licenses in storage
  • Feed failed contents (the ones that were tagged, license unknown) back in
ardumont mentioned this in rDCIDX56c18edea9d5: producer: Reuse producer to send batch of data to index.Nov 15 2016, 6:16 PM
ardumont mentioned this in rDSTOf454e448645e: storage: Update recognized fossology licenses.Nov 18 2016, 1:57 PM
ardumont mentioned this in rDSTOf5ece61cba3e: storage: Add indexer_configuration table json schema.Nov 18 2016, 2:55 PM
ardumont closed this task as Resolved.Nov 18 2016, 3:53 PM
ardumont mentioned this in rSPSITE6039318a40c6: swh::deploy::worker::swh_indexer_fossology_license: Add manifest.Jun 15 2018, 2:29 PM
ardumont mentioned this in rSPSITEdd8a5eb4707a: swh::deploy::indexer: Upgrade indexer package when available.
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 4:20 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal