Page MenuHomeSoftware Heritage

Origin-npmTag
ActivePublic

Members

  • This project does not have any members.

Watchers

  • This project does not have any watchers.

Recent Activity

Sun, Oct 13

ardumont changed the status of T2025: Re-implement debian loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Sun, Oct 13, 6:37 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Sat, Oct 5

ardumont added a project to T1389: Implement a base "package" loader for package managers: Origin-Debian.
Sat, Oct 5, 2:30 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont added a project to T1389: Implement a base "package" loader for package managers: Origin-CRAN.
Sat, Oct 5, 2:29 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Thu, Oct 3

ardumont changed the status of T2024: Re-implement deposit loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Thu, Oct 3, 6:03 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Tue, Oct 1

ardumont closed T2017: package loader: Discuss revision metadata normalization, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
Tue, Oct 1, 6:46 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont added a subtask for T1389: Implement a base "package" loader for package managers: T2017: package loader: Discuss revision metadata normalization.
Tue, Oct 1, 6:46 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont added a project to T1389: Implement a base "package" loader for package managers: Origin-GNU.
Tue, Oct 1, 6:40 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont triaged T2026: Implement cran loader with package manager mechanism as Normal priority.
Tue, Oct 1, 1:29 PM · Origin-CRAN, Archive coverage
ardumont added a comment to T1389: Implement a base "package" loader for package managers.

Current work is in the swh-loader-repository within the package-loader branch.

Tue, Oct 1, 1:23 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont renamed T1389: Implement a base "package" loader for package managers from Implement a base loader for package managers to Implement a base "package" loader for package managers.
Tue, Oct 1, 1:20 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T1389: Implement a base "package" loader for package managers from Open to Work in Progress.
Tue, Oct 1, 1:20 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T2021: Re-implement pypi loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Tue, Oct 1, 1:19 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T2022: Re-implement npm loader with base loader, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Tue, Oct 1, 1:19 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T2022: Re-implement npm loader with base loader from Open to Work in Progress.
Tue, Oct 1, 1:19 PM · Origin-npm, Archive coverage
ardumont removed a project from T2022: Re-implement npm loader with base loader: Origin-Pypi.
Tue, Oct 1, 1:18 PM · Origin-npm, Archive coverage
ardumont changed the status of T2023: Re-implement gnu loader with package loader from Open to Work in Progress.
Tue, Oct 1, 1:14 PM · Origin-GNU, Archive coverage
ardumont triaged T2022: Re-implement npm loader with base loader as Normal priority.
Tue, Oct 1, 1:12 PM · Origin-npm, Archive coverage
ardumont triaged T2021: Re-implement pypi loader with package loader as Normal priority.
Tue, Oct 1, 1:11 PM · Origin-Pypi, Archive coverage

Sep 13 2019

nahimilega added a comment to T1389: Implement a base "package" loader for package managers.

@douardda We have a separate task(T1777) for rubygem lister. I guess we can add a separate column in the table by @anlambert showing status of the lister implementation and the tasks related to it.

Sep 13 2019, 9:03 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Sep 12 2019

douardda added a comment to T1389: Implement a base "package" loader for package managers.
Package managerPackages listing url Package metadata urlPackage source tarball url
RubygemsNo public api endpoint availablehttps://rubygems.org/api/v2/rubygems/[package]/versions/[version].jsonavailable in the medata
Sep 12 2019, 11:08 AM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Jul 7 2019

nahimilega added a revision to T1389: Implement a base "package" loader for package managers: D1694: swh.loader.package: Implement a method to prepare package visit.
Jul 7 2019, 10:10 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Jul 2 2019

nahimilega added a comment to T1389: Implement a base "package" loader for package managers.

Extending over the plan by @olasd. Here are some of my thoughts on the implementation of base loader.

Jul 2 2019, 12:46 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Jun 17 2019

olasd added a comment to T1389: Implement a base "package" loader for package managers.
In T1389#33215, @zack wrote:

Thanks @olasd, @ardumont, and @anlambert for this, it's a great plan and I like it a lot !
Just a few comments on the sidelines:

The lister will generate a one-shot task to load each package for the given repository, with the full information needed to do the data fetching.

This seemed clear from a different part of the description, but fwiw here I'm assuming the plan is to only load the version of the packages not already known/ingested in the past.

Jun 17 2019, 4:19 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Jun 12 2019

zack added a comment to T1389: Implement a base "package" loader for package managers.

Thanks @olasd, @ardumont, and @anlambert for this, it's a great plan and I like it a lot !

Jun 12 2019, 1:58 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Jun 7 2019

rdicosmo moved T1766: Write blog post about the npm ingestion from Restricted Project Column to Restricted Project Column on the Unknown Object (Project) board.
Jun 7 2019, 6:14 PM · Origin-npm, Blog, Website, Unknown Object (Project)

Jun 3 2019

vlorentz moved T1766: Write blog post about the npm ingestion from Restricted Project Column to Restricted Project Column on the Unknown Object (Project) board.
Jun 3 2019, 11:34 AM · Origin-npm, Blog, Website, Unknown Object (Project)
vlorentz moved T1766: Write blog post about the npm ingestion from Restricted Project Column to Restricted Project Column on the Unknown Object (Project) board.
Jun 3 2019, 11:34 AM · Origin-npm, Blog, Website, Unknown Object (Project)

May 27 2019

anlambert triaged T1766: Write blog post about the npm ingestion as Normal priority.
May 27 2019, 3:39 PM · Origin-npm, Blog, Website, Unknown Object (Project)
anlambert closed T1378: Ingest npm into the Software Heritage archive (meta task) as Resolved.

npm is now archived continuously by Software Heritage (see for instance: https://archive.softwareheritage.org/browse/origin/https://www.npmjs.com/package/webpack/).

May 27 2019, 1:58 PM · Origin-npm, Archive coverage
anlambert closed T1761: Add npm logo to the archive coverage page, a subtask of T1378: Ingest npm into the Software Heritage archive (meta task), as Resolved.
May 27 2019, 1:41 PM · Origin-npm, Archive coverage
anlambert closed T1761: Add npm logo to the archive coverage page as Resolved by committing rDWAPPS26f94f6244a7: misc/coverage: Add npm origin type.
May 27 2019, 1:41 PM · Origin-npm, Archive coverage
anlambert triaged T1761: Add npm logo to the archive coverage page as Normal priority.
May 27 2019, 10:51 AM · Origin-npm, Archive coverage
anlambert closed T1629: Deploy the npm ingestion in production as Resolved.

It is done ! npm packages are now available in the archive content so closing this.

May 27 2019, 10:48 AM · Origin-npm

May 25 2019

zack added a comment to T1378: Ingest npm into the Software Heritage archive (meta task).

I think the only thing missing here is adding the NPM logo to the archive coverage page.

May 25 2019, 5:37 PM · Origin-npm, Archive coverage
zack added a comment to T1629: Deploy the npm ingestion in production.

I think this is now done, right @anlambert ?

May 25 2019, 5:37 PM · Origin-npm

May 20 2019

olasd updated subscribers of T1389: Implement a base "package" loader for package managers.

We've discussed a plausible plan for a "base package manager loader" with @ardumont and, to some extent, @anlambert.

May 20 2019, 6:03 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Apr 12 2019

anlambert closed T1644: Fix errors detected after a first loading batch as Resolved by committing rDLDNPMb234386f8ad5: npm.client: Handle parsing of package.json file non utf8 encoded.
Apr 12 2019, 10:48 AM · Origin-npm
anlambert closed T1644: Fix errors detected after a first loading batch, a subtask of T1629: Deploy the npm ingestion in production, as Resolved.
Apr 12 2019, 10:48 AM · Origin-npm

Apr 11 2019

anlambert triaged T1644: Fix errors detected after a first loading batch as Normal priority.
Apr 11 2019, 3:08 PM · Origin-npm
ardumont added a comment to T1629: Deploy the npm ingestion in production.

I've stopped the npm loader, and created a new dashboard to track the errors [1]

Apr 11 2019, 2:06 PM · Origin-npm
ardumont closed T1632: Update workers configuration for the npm ingestion, a subtask of T1629: Deploy the npm ingestion in production, as Resolved.
Apr 11 2019, 2:06 PM · Origin-npm
ardumont closed T1631: Add new scheduler task types for npm ingestion, a subtask of T1629: Deploy the npm ingestion in production, as Resolved.
Apr 11 2019, 1:46 PM · Origin-npm

Apr 10 2019

ardumont closed T1634: Create database for npm lister as Resolved.
Apr 10 2019, 3:57 PM · Npm Lister, Origin-npm
ardumont closed T1634: Create database for npm lister, a subtask of T1629: Deploy the npm ingestion in production, as Resolved.
Apr 10 2019, 3:57 PM · Origin-npm
ardumont added a comment to T1634: Create database for npm lister.
  1. Create role
Apr 10 2019, 3:57 PM · Npm Lister, Origin-npm
anlambert added a project to T1634: Create database for npm lister: Npm Lister.
Apr 10 2019, 10:53 AM · Npm Lister, Origin-npm
anlambert triaged T1634: Create database for npm lister as Normal priority.
Apr 10 2019, 10:53 AM · Npm Lister, Origin-npm

Apr 9 2019

olasd closed T1630: Add debian packaging for the npm loader, a subtask of T1629: Deploy the npm ingestion in production, as Resolved.
Apr 9 2019, 5:22 PM · Origin-npm
anlambert added a project to T1629: Deploy the npm ingestion in production: Origin-npm.
Apr 9 2019, 11:49 AM · Origin-npm

Apr 2 2019

anlambert closed T1379: npm loader, a subtask of T1378: Ingest npm into the Software Heritage archive (meta task), as Resolved.
Apr 2 2019, 3:38 PM · Origin-npm, Archive coverage