Page MenuHomeSoftware Heritage
Create Task
Maniphest T1629

Deploy the npm ingestion in production
Closed, MigratedEdits Locked
Actions

Description

We now have working and tested lister and loader for the npm registry.

It is time to deploy it to production environment.

Related Objects
Search...

Event Timeline

anlambert triaged this task as Normal priority.Apr 9 2019, 11:40 AM
anlambert created this task.
anlambert added a project: Origin-npm.Apr 9 2019, 11:49 AM
olasd closed subtask T1630: Add debian packaging for the npm loader as Resolved.Apr 9 2019, 5:22 PM
anlambert mentioned this in rDLS8ffd8dadefa3: cli: Fix initialization for all listers.Apr 10 2019, 11:34 AM
ardumont closed subtask T1634: Create database for npm lister as Resolved.Apr 10 2019, 3:57 PM
anlambert mentioned this in D1400: Add npm related task types.Apr 10 2019, 6:26 PM
anlambert mentioned this in rDSCH4b0e9527cb38: sql/data: Add npm related task types.Apr 10 2019, 6:34 PM
ardumont closed subtask T1631: Add new scheduler task types for npm ingestion as Resolved.Apr 11 2019, 1:46 PM
ardumont closed subtask T1632: Update workers configuration for the npm ingestion as Resolved.EditedApr 11 2019, 2:06 PM
ardumont added a subscriber: ardumont.

Deployed.

I've stopped the npm loader, and created a new dashboard to track the errors [1]

http://kibana0.internal.softwareheritage.org:5601/app/kibana#/dashboard/07631b40-5c52-11e9-b8ce-cf95f437ce37

anlambert mentioned this in D1408: extract_npm_package_author: Handle list of dict authors layout.Apr 11 2019, 2:50 PM
anlambert closed subtask T1644: Fix errors detected after a first loading batch as Resolved.Apr 12 2019, 10:48 AM
zack added a subscriber: zack.May 25 2019, 5:37 PM

I think this is now done, right @anlambert ?

anlambert closed this task as Resolved.May 27 2019, 10:48 AM
anlambert claimed this task.

It is done ! npm packages are now available in the archive content so closing this.

gitlab-migration changed the status of subtask T1632: Update workers configuration for the npm ingestion from Resolved to Migrated.Oct 19 2022, 5:51 PM
gitlab-migration changed the status of subtask T1630: Add debian packaging for the npm loader from Resolved to Migrated.Jan 8 2023, 4:26 PM
gitlab-migration changed the status of subtask T1631: Add new scheduler task types for npm ingestion from Resolved to Migrated.
gitlab-migration changed the status of subtask T1634: Create database for npm lister from Resolved to Migrated.
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 9:59 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

gitlab-migration changed the status of subtask T1644: Fix errors detected after a first loading batch from Resolved to Migrated.Jan 8 2023, 9:59 PM
About · Developer information · Legal