- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Jan 8 2023
Jan 8 2023
gitlab-migration changed the status of T2023: Re-implement gnu loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
gitlab-migration changed the status of T2022: Re-implement npm loader with base loader from Resolved to Migrated.
gitlab-migration changed the status of T2022: Re-implement npm loader with base loader, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
gitlab-migration changed the status of T2021: Re-implement pypi loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
gitlab-migration changed the status of T1761: Add npm logo to the archive coverage page from Resolved to Migrated.
gitlab-migration changed the status of T1761: Add npm logo to the archive coverage page, a subtask of T1378: Ingest npm into the Software Heritage archive (meta task), from Resolved to Migrated.
gitlab-migration changed the status of T1644: Fix errors detected after a first loading batch, a subtask of T1629: Deploy the npm ingestion in production, from Resolved to Migrated.
gitlab-migration changed the status of T1644: Fix errors detected after a first loading batch from Resolved to Migrated.
gitlab-migration changed the status of T1629: Deploy the npm ingestion in production from Resolved to Migrated.
gitlab-migration changed the status of T1389: Implement a base "package" loader for package managers from Resolved to Migrated.
gitlab-migration changed the status of T1378: Ingest npm into the Software Heritage archive (meta task) from Resolved to Migrated.
gitlab-migration changed the status of T2025: Re-implement debian loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
gitlab-migration changed the status of T2024: Re-implement deposit loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
gitlab-migration changed the status of T2017: package loader: Discuss revision metadata normalization, a subtask of T1389: Implement a base "package" loader for package managers, from Resolved to Migrated.
gitlab-migration changed the status of T1634: Create database for npm lister, a subtask of T1629: Deploy the npm ingestion in production, from Resolved to Migrated.
gitlab-migration changed the status of T1634: Create database for npm lister from Resolved to Migrated.
gitlab-migration changed the status of T1631: Add new scheduler task types for npm ingestion, a subtask of T1629: Deploy the npm ingestion in production, from Resolved to Migrated.
gitlab-migration changed the status of T1630: Add debian packaging for the npm loader, a subtask of T1629: Deploy the npm ingestion in production, from Resolved to Migrated.
gitlab-migration changed the status of T1398: npm incremental lister, a subtask of T1378: Ingest npm into the Software Heritage archive (meta task), from Resolved to Migrated.
gitlab-migration changed the status of T1380: npm lister, a subtask of T1378: Ingest npm into the Software Heritage archive (meta task), from Resolved to Migrated.
gitlab-migration changed the status of T1379: npm loader, a subtask of T1378: Ingest npm into the Software Heritage archive (meta task), from Resolved to Migrated.
Oct 19 2022
Oct 19 2022
gitlab-migration changed the status of T1632: Update workers configuration for the npm ingestion, a subtask of T1629: Deploy the npm ingestion in production, from Resolved to Migrated.
May 18 2020
May 18 2020
May 9 2020
May 9 2020
rdicosmo moved T1766: Write blog post about the npm ingestion from Restricted Project Column to Restricted Project Column on the Unknown Object (Project) board.
Nov 26 2019
Nov 26 2019
ardumont removed a parent task for T2098: Deploy package loaders: T1389: Implement a base "package" loader for package managers.
ardumont removed a subtask for T1389: Implement a base "package" loader for package managers: T2098: Deploy package loaders.
Nov 22 2019
Nov 22 2019
ardumont updated the test plan for D2344: npm: Explicitely retrieve the revision date from extrinsic metadata.
Nov 20 2019
Nov 20 2019
Nov 19 2019
Nov 19 2019
ardumont closed T2025: Re-implement debian loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
ardumont closed T2024: Re-implement deposit loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
ardumont closed T2023: Re-implement gnu loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
ardumont closed T2022: Re-implement npm loader with base loader, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
ardumont closed T2021: Re-implement pypi loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
Oct 13 2019
Oct 13 2019
ardumont changed the status of T2025: Re-implement debian loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Oct 5 2019
Oct 5 2019
ardumont added a project to T1389: Implement a base "package" loader for package managers: Origin-Debian.
ardumont added a project to T1389: Implement a base "package" loader for package managers: Origin-CRAN.
Oct 3 2019
Oct 3 2019
ardumont changed the status of T2024: Re-implement deposit loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Oct 1 2019
Oct 1 2019
ardumont closed T2017: package loader: Discuss revision metadata normalization, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
ardumont added a project to T1389: Implement a base "package" loader for package managers: Origin-GNU.
Current work is in the swh-loader-repository within the package-loader branch.
ardumont renamed T1389: Implement a base "package" loader for package managers from Implement a base loader for package managers to Implement a base "package" loader for package managers.
ardumont changed the status of T1389: Implement a base "package" loader for package managers from Open to Work in Progress.
ardumont changed the status of T2021: Re-implement pypi loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
ardumont changed the status of T2022: Re-implement npm loader with base loader, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
ardumont changed the status of T2022: Re-implement npm loader with base loader from Open to Work in Progress.
ardumont changed the status of T2023: Re-implement gnu loader with package loader from Open to Work in Progress.
Sep 13 2019
Sep 13 2019
@douardda We have a separate task(T1777) for rubygem lister. I guess we can add a separate column in the table by @anlambert showing status of the lister implementation and the tasks related to it.
Sep 12 2019
Sep 12 2019
In T1389#27957, @anlambert wrote:
Package manager Packages listing url Package metadata url Package source tarball url Rubygems No public api endpoint available https://rubygems.org/api/v2/rubygems/[package]/versions/[version].json available in the medata
Jul 7 2019
Jul 7 2019
Jul 2 2019
Jul 2 2019
Extending over the plan by @olasd. Here are some of my thoughts on the implementation of base loader.
Jun 17 2019
Jun 17 2019
In T1389#33215, @zack wrote:Thanks @olasd, @ardumont, and @anlambert for this, it's a great plan and I like it a lot !
Just a few comments on the sidelines:
The lister will generate a one-shot task to load each package for the given repository, with the full information needed to do the data fetching.
This seemed clear from a different part of the description, but fwiw here I'm assuming the plan is to only load the version of the packages not already known/ingested in the past.
Jun 12 2019
Jun 12 2019
Thanks @olasd, @ardumont, and @anlambert for this, it's a great plan and I like it a lot !
Jun 7 2019
Jun 7 2019
rdicosmo moved T1766: Write blog post about the npm ingestion from Restricted Project Column to Restricted Project Column on the Unknown Object (Project) board.
Jun 3 2019
Jun 3 2019
vlorentz moved T1766: Write blog post about the npm ingestion from Restricted Project Column to Restricted Project Column on the Unknown Object (Project) board.
vlorentz moved T1766: Write blog post about the npm ingestion from Restricted Project Column to Restricted Project Column on the Unknown Object (Project) board.
May 27 2019
May 27 2019
npm is now archived continuously by Software Heritage (see for instance: https://archive.softwareheritage.org/browse/origin/https://www.npmjs.com/package/webpack/).
anlambert closed T1761: Add npm logo to the archive coverage page, a subtask of T1378: Ingest npm into the Software Heritage archive (meta task), as Resolved.
anlambert closed T1761: Add npm logo to the archive coverage page as Resolved by committing rDWAPPS26f94f6244a7: misc/coverage: Add npm origin type.
It is done ! npm packages are now available in the archive content so closing this.
May 25 2019
May 25 2019
I think the only thing missing here is adding the NPM logo to the archive coverage page.
I think this is now done, right @anlambert ?
May 20 2019
May 20 2019
We've discussed a plausible plan for a "base package manager loader" with @ardumont and, to some extent, @anlambert.
Apr 12 2019
Apr 12 2019
anlambert closed T1644: Fix errors detected after a first loading batch, a subtask of T1629: Deploy the npm ingestion in production, as Resolved.
Apr 11 2019
Apr 11 2019
I've stopped the npm loader, and created a new dashboard to track the errors [1]
ardumont closed T1632: Update workers configuration for the npm ingestion, a subtask of T1629: Deploy the npm ingestion in production, as Resolved.
ardumont closed T1631: Add new scheduler task types for npm ingestion, a subtask of T1629: Deploy the npm ingestion in production, as Resolved.
Apr 10 2019
Apr 10 2019
ardumont closed T1634: Create database for npm lister, a subtask of T1629: Deploy the npm ingestion in production, as Resolved.
- Create role
Apr 9 2019
Apr 9 2019
olasd closed T1630: Add debian packaging for the npm loader, a subtask of T1629: Deploy the npm ingestion in production, as Resolved.
Apr 2 2019
Apr 2 2019
anlambert closed T1379: npm loader, a subtask of T1378: Ingest npm into the Software Heritage archive (meta task), as Resolved.
anlambert closed T1379: npm loader as Resolved by committing rDLDNPM35dd880e7725: swh.loader.npm.tasks: Add npm loader celery task.