Page MenuHomeSoftware Heritage

Pipeline copy content to azure and then compute multiple indexes independently (meta task)
Closed, MigratedEdits Locked

Description

We need to copy contents to azure blob storage (this is already done by the archiver).
The idea is once that copy is done, send those contents for computing multiple indexes on them (mimetype, language detection, sloc count, etc...).

Event Timeline

ardumont shifted this object from the Restricted Space space to the S1 Public space.Oct 5 2016, 11:08 AM
ardumont changed the status of subtask T596: Add license indexer from Open to Work in Progress.Nov 15 2016, 4:31 PM
gitlab-migration changed the status of subtask T576: Indexer orchestrator from Resolved to Migrated.
gitlab-migration changed the status of subtask T577: Mimetype/Encoding indexer from Resolved to Migrated.
gitlab-migration changed the status of subtask T578: Language indexer from Resolved to Migrated.
gitlab-migration changed the status of subtask T580: Start indexing computations (mimetype, language) from Resolved to Migrated.
gitlab-migration changed the status of subtask T583: Update puppet manifests according to latest developments from Resolved to Migrated.
gitlab-migration changed the status of subtask T584: Deploy and run latest indexer code from Resolved to Migrated.
gitlab-migration changed the status of subtask T589: Add ctags content indexer from Resolved to Migrated.
gitlab-migration changed the status of subtask T596: Add license indexer from Resolved to Migrated.