Page MenuHomeSoftware Heritage
Feed Advanced Search

Yesterday

olasd updated the task description for T2345: Improve handling of recurrent loading tasks in scheduler.
Fri, Apr 3, 9:34 AM · Archive coverage, Scheduling utilities

Thu, Apr 2

olasd updated the task description for T2345: Improve handling of recurrent loading tasks in scheduler.
Thu, Apr 2, 7:24 PM · Archive coverage, Scheduling utilities
olasd updated the task description for T2345: Improve handling of recurrent loading tasks in scheduler.
Thu, Apr 2, 7:23 PM · Archive coverage, Scheduling utilities
olasd updated the task description for T2345: Improve handling of recurrent loading tasks in scheduler.
Thu, Apr 2, 10:02 AM · Archive coverage, Scheduling utilities
olasd added projects to T2345: Improve handling of recurrent loading tasks in scheduler: Scheduling utilities, Archive coverage.
Thu, Apr 2, 9:39 AM · Archive coverage, Scheduling utilities

Tue, Mar 24

legau added a comment to T1734: Create a Lister for launchpad.net.

Hi, I proposed a first version with the new changes (D2799).
@cjwatson it should be coherent with your snippet.
If somebody is used to be working with listers I would be glad to hear some remarks over how I implemented it.

Tue, Mar 24, 3:50 PM · Lister, Archive coverage
zack updated the task description for T2313: Archive git.fsfe.org (Gitea).
Tue, Mar 24, 1:40 PM · Archive coverage, Lister

Fri, Mar 13

olasd added a comment to T2313: Archive git.fsfe.org (Gitea).

Unfortunately, try.gogs.io's API is hidden behind auth so I can't confirm that the responses actually have the same shape between gogs and gitea.

Fri, Mar 13, 1:26 PM · Archive coverage, Lister
olasd added a comment to T2313: Archive git.fsfe.org (Gitea).

Thanks for submitting this request. There's a good chance that this can be the same lister as gogs: T1721.

Fri, Mar 13, 1:25 PM · Archive coverage, Lister
olasd added projects to T2313: Archive git.fsfe.org (Gitea): Lister, Archive coverage.
Fri, Mar 13, 1:21 PM · Archive coverage, Lister

Thu, Mar 12

cjwatson added a comment to T1734: Create a Lister for launchpad.net.

Yep, I'm not annoyed, just being emphatic about what we want to see. :-)

Thu, Mar 12, 6:29 PM · Lister, Archive coverage
zack added a comment to T1734: Create a Lister for launchpad.net.

Hi Colin (@cjwatson), nice to meet you here !

Thu, Mar 12, 1:35 PM · Lister, Archive coverage

Wed, Mar 11

cjwatson added a comment to T1734: Create a Lister for launchpad.net.

I'm one of the developers on the Launchpad team. A user identified as "leni" spoke to us about this on IRC last week; it so happened that the Launchpad team were in the middle of an in-person sprint at the time, so we were able to discuss the problem fairly quickly and put together a plan to improve our API. I implemented those improvements shortly afterwards. They aren't quite deployed on production yet, but they should be very soon. Unfortunately I don't have any contact details for leni unless they happen to join IRC, so I'm posting a summary of the discussion and my improvements here, which is probably a useful thing to do anyway.

Wed, Mar 11, 11:09 PM · Lister, Archive coverage

Feb 13 2020

legau added a comment to T1734: Create a Lister for launchpad.net.

What is the current status of this task ?

Feb 13 2020, 2:34 PM · Lister, Archive coverage

Feb 6 2020

zack added a comment to T1351: (periodically) ingest GNU package releases.

Given this is done, where can one see the timeline of visits for a given origin coming from GNU?

Feb 6 2020, 8:25 PM · Archive coverage
ardumont closed T1351: (periodically) ingest GNU package releases as Resolved.
Feb 6 2020, 7:16 PM · Archive coverage
ardumont closed T1723: GNU Loader, a subtask of T1351: (periodically) ingest GNU package releases, as Resolved.
Feb 6 2020, 7:16 PM · Archive coverage
ardumont closed T1723: GNU Loader as Resolved.
Feb 6 2020, 7:16 PM · Archive coverage

Jan 27 2020

vlorentz added a project to T1734: Create a Lister for launchpad.net: Lister.
Jan 27 2020, 4:31 PM · Lister, Archive coverage

Jan 21 2020

ardumont closed T2029: cran lister: Align lister to output list of tarballs per origin as Resolved.

Deployed.

Jan 21 2020, 11:45 AM · Origin-CRAN, Archive coverage
ardumont closed T2029: cran lister: Align lister to output list of tarballs per origin, a subtask of T2026: Implement cran loader with package manager mechanism, as Resolved.
Jan 21 2020, 11:45 AM · Origin-CRAN, Archive coverage

Jan 17 2020

ardumont added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.

The original description of this task was adapted by D2531 D2532 D2524.
A sample of what's been listed and ingested can be seen through the staging webapp instance [1].

Jan 17 2020, 12:35 PM · Origin-CRAN, Archive coverage
ardumont renamed T2029: cran lister: Align lister to output list of tarballs per origin from cran lister: Align lister to output list of tarballs per origin (if possible) to cran lister: Align lister to output list of tarballs per origin.
Jan 17 2020, 12:25 PM · Origin-CRAN, Archive coverage

Jan 16 2020

ardumont added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.

In the [2] page, there is an archive link (or something) which lists the old associated artifacts (so apriori, no more need for the mran mirror).

Jan 16 2020, 1:47 PM · Origin-CRAN, Archive coverage
olasd added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.
Jan 16 2020, 1:44 PM · Origin-CRAN, Archive coverage
ardumont added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.

Heads up.

Jan 16 2020, 11:27 AM · Origin-CRAN, Archive coverage

Jan 9 2020

ardumont closed T2026: Implement cran loader with package manager mechanism as Resolved.

Deployed.

Jan 9 2020, 1:48 PM · Origin-CRAN, Archive coverage

Nov 26 2019

ardumont closed T2098: Deploy package loaders as Resolved.
Nov 26 2019, 5:28 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont updated the task description for T2098: Deploy package loaders.
Nov 26 2019, 5:28 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont closed T1389: Implement a base "package" loader for package managers as Resolved.
Nov 26 2019, 12:25 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont removed a parent task for T2098: Deploy package loaders: T1389: Implement a base "package" loader for package managers.
Nov 26 2019, 12:24 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont removed a subtask for T1389: Implement a base "package" loader for package managers: T2098: Deploy package loaders.
Nov 26 2019, 12:24 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont removed a subtask for T2024: Re-implement deposit loader with package loader mechanism: T1755: Create artifact release when 'releaseNotes' is in metadata .
Nov 26 2019, 12:19 PM · SWORD deposit, Archive coverage
ardumont updated the task description for T2098: Deploy package loaders.
Nov 26 2019, 12:13 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont updated the task description for T2026: Implement cran loader with package manager mechanism.
Nov 26 2019, 11:39 AM · Origin-CRAN, Archive coverage

Nov 20 2019

ardumont updated the task description for T2098: Deploy package loaders.
Nov 20 2019, 9:42 AM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Nov 19 2019

ardumont added a comment to T2026: Implement cran loader with package manager mechanism.

Removing that package loader implementation from the main task.
It's not a blocker to close the main task.

Nov 19 2019, 12:28 PM · Origin-CRAN, Archive coverage
ardumont removed a subtask for T1389: Implement a base "package" loader for package managers: T2026: Implement cran loader with package manager mechanism.
Nov 19 2019, 12:27 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont removed a parent task for T2026: Implement cran loader with package manager mechanism: T1389: Implement a base "package" loader for package managers.
Nov 19 2019, 12:27 PM · Origin-CRAN, Archive coverage
ardumont closed T2025: Re-implement debian loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
Nov 19 2019, 12:26 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont closed T2025: Re-implement debian loader with package loader mechanism as Resolved.
Nov 19 2019, 12:26 PM · Origin-Debian, Debian loader, Archive coverage
ardumont closed T2024: Re-implement deposit loader with package loader mechanism as Resolved.
Nov 19 2019, 12:26 PM · SWORD deposit, Archive coverage
ardumont closed T2024: Re-implement deposit loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
Nov 19 2019, 12:26 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont closed T2023: Re-implement gnu loader with package loader as Resolved.
Nov 19 2019, 12:26 PM · Origin-GNU, Archive coverage
ardumont closed T2023: Re-implement gnu loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
Nov 19 2019, 12:26 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont closed T2022: Re-implement npm loader with base loader, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
Nov 19 2019, 12:25 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont closed T2022: Re-implement npm loader with base loader as Resolved.
Nov 19 2019, 12:25 PM · Origin-npm, Archive coverage
ardumont closed T2021: Re-implement pypi loader with package loader as Resolved.
Nov 19 2019, 12:25 PM · Origin-Pypi, Archive coverage
ardumont closed T2021: Re-implement pypi loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
Nov 19 2019, 12:25 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont triaged T2098: Deploy package loaders as Normal priority.
Nov 19 2019, 12:25 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage

Nov 14 2019

ardumont added a comment to T2025: Re-implement debian loader with package loader mechanism.

Latest debian lister and debian loader deployed.

Nov 14 2019, 11:40 AM · Origin-Debian, Debian loader, Archive coverage

Oct 13 2019

ardumont changed the status of T2025: Re-implement debian loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Oct 13 2019, 6:37 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T2025: Re-implement debian loader with package loader mechanism from Open to Work in Progress.
Oct 13 2019, 6:37 PM · Origin-Debian, Debian loader, Archive coverage

Oct 12 2019

ardumont added a comment to T2025: Re-implement debian loader with package loader mechanism.

Current input of the debian loader (without the optimization) (outputed from the lister):

Oct 12 2019, 9:27 AM · Origin-Debian, Debian loader, Archive coverage

Oct 6 2019

ardumont added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.

Some experiments with the R versions package:

Oct 6 2019, 12:08 PM · Origin-CRAN, Archive coverage
ardumont updated the task description for T2029: cran lister: Align lister to output list of tarballs per origin.
Oct 6 2019, 10:09 AM · Origin-CRAN, Archive coverage

Oct 5 2019

ardumont added a project to T2025: Re-implement debian loader with package loader mechanism: Origin-Debian.
Oct 5 2019, 2:31 PM · Origin-Debian, Debian loader, Archive coverage
ardumont added a project to T1389: Implement a base "package" loader for package managers: Origin-Debian.
Oct 5 2019, 2:30 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont added a project to T1389: Implement a base "package" loader for package managers: Origin-CRAN.
Oct 5 2019, 2:29 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont added a project to T2029: cran lister: Align lister to output list of tarballs per origin: Origin-CRAN.
Oct 5 2019, 2:28 PM · Origin-CRAN, Archive coverage
ardumont added a project to T2026: Implement cran loader with package manager mechanism: Origin-CRAN.
Oct 5 2019, 2:28 PM · Origin-CRAN, Archive coverage

Oct 3 2019

ardumont added a comment to T2026: Implement cran loader with package manager mechanism.

Here are some analysis sample on the cran dataset about publication "date" and "author" fields.

Oct 3 2019, 7:31 PM · Origin-CRAN, Archive coverage
ardumont added a comment to T2024: Re-implement deposit loader with package loader mechanism.

Implementation done.

Oct 3 2019, 6:05 PM · SWORD deposit, Archive coverage
ardumont changed the status of T2024: Re-implement deposit loader with package loader mechanism, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Oct 3 2019, 6:03 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T2024: Re-implement deposit loader with package loader mechanism from Open to Work in Progress.
Oct 3 2019, 6:03 PM · SWORD deposit, Archive coverage
ardumont added a subtask for T2024: Re-implement deposit loader with package loader mechanism: T1755: Create artifact release when 'releaseNotes' is in metadata .
Oct 3 2019, 6:01 PM · SWORD deposit, Archive coverage
ardumont updated the task description for T2024: Re-implement deposit loader with package loader mechanism.
Oct 3 2019, 6:01 PM · SWORD deposit, Archive coverage

Oct 2 2019

ardumont added a comment to T2026: Implement cran loader with package manager mechanism.

To have a look at possible fields (regarding parsing date and author), here is a sample of the artifacts listed by the cran lister [1]

Oct 2 2019, 11:39 AM · Origin-CRAN, Archive coverage
ardumont added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.

thanks! \m/

Oct 2 2019, 11:37 AM · Origin-CRAN, Archive coverage
anlambert added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.

In order to list all available versions of a R package hosted on CRAN, the versions package could be used.

Oct 2 2019, 11:19 AM · Origin-CRAN, Archive coverage
ardumont renamed T2029: cran lister: Align lister to output list of tarballs per origin from cran lister: Align lister output to gnu one to cran lister: Align lister to output list of tarballs per origin (if possible).
Oct 2 2019, 6:47 AM · Origin-CRAN, Archive coverage
ardumont triaged T2029: cran lister: Align lister to output list of tarballs per origin as Normal priority.
Oct 2 2019, 6:47 AM · Origin-CRAN, Archive coverage

Oct 1 2019

ardumont added a comment to T2026: Implement cran loader with package manager mechanism.
def parse_debian_control(filepath: str) -> Dict:
    """Parse debian control at filepath"""
    metadata = {}
    logger.debug('Debian control file %s', filepath)
    for paragraph in Deb822.iter_paragraphs(open(filepath)):
        logger.debug('paragraph: %s', paragraph)
        metadata.update(**paragraph)
Oct 1 2019, 7:29 PM · Origin-CRAN, Archive coverage
ardumont updated the task description for T2026: Implement cran loader with package manager mechanism.
Oct 1 2019, 6:55 PM · Origin-CRAN, Archive coverage
ardumont updated the task description for T2026: Implement cran loader with package manager mechanism.
Oct 1 2019, 6:53 PM · Origin-CRAN, Archive coverage
ardumont updated the task description for T2026: Implement cran loader with package manager mechanism.
Oct 1 2019, 6:49 PM · Origin-CRAN, Archive coverage
ardumont closed T2017: package loader: Discuss revision metadata normalization, a subtask of T1389: Implement a base "package" loader for package managers, as Resolved.
Oct 1 2019, 6:46 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont added a subtask for T1389: Implement a base "package" loader for package managers: T2017: package loader: Discuss revision metadata normalization.
Oct 1 2019, 6:46 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont removed projects from T2026: Implement cran loader with package manager mechanism: Origin-npm, Origin-Pypi.
Oct 1 2019, 6:40 PM · Origin-CRAN, Archive coverage
ardumont added a project to T1389: Implement a base "package" loader for package managers: Origin-GNU.
Oct 1 2019, 6:40 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont triaged T2026: Implement cran loader with package manager mechanism as Normal priority.
Oct 1 2019, 1:29 PM · Origin-CRAN, Archive coverage
ardumont added a comment to T1389: Implement a base "package" loader for package managers.

Current work is in the swh-loader-repository within the package-loader branch.

Oct 1 2019, 1:23 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont triaged T2025: Re-implement debian loader with package loader mechanism as Normal priority.
Oct 1 2019, 1:22 PM · Origin-Debian, Debian loader, Archive coverage
ardumont renamed T2024: Re-implement deposit loader with package loader mechanism from Re-implement loader deposit with package loader mechanism to Re-implement deposit loader with package loader mechanism.
Oct 1 2019, 1:21 PM · SWORD deposit, Archive coverage
ardumont renamed T1389: Implement a base "package" loader for package managers from Implement a base loader for package managers to Implement a base "package" loader for package managers.
Oct 1 2019, 1:20 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T1389: Implement a base "package" loader for package managers from Open to Work in Progress.
Oct 1 2019, 1:20 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T2021: Re-implement pypi loader with package loader from Open to Work in Progress.
Oct 1 2019, 1:19 PM · Origin-Pypi, Archive coverage
ardumont changed the status of T2021: Re-implement pypi loader with package loader, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Oct 1 2019, 1:19 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T2022: Re-implement npm loader with base loader, a subtask of T1389: Implement a base "package" loader for package managers, from Open to Work in Progress.
Oct 1 2019, 1:19 PM · Origin-Debian, Origin-CRAN, Origin-GNU, Origin-npm, Origin-Pypi, Archive coverage
ardumont changed the status of T2022: Re-implement npm loader with base loader from Open to Work in Progress.
Oct 1 2019, 1:19 PM · Origin-npm, Archive coverage
ardumont removed a project from T2022: Re-implement npm loader with base loader: Origin-Pypi.
Oct 1 2019, 1:18 PM · Origin-npm, Archive coverage
ardumont renamed T2021: Re-implement pypi loader with package loader from Re-implement pypi loader with base loader to Re-implement pypi loader with package loader.
Oct 1 2019, 1:18 PM · Origin-Pypi, Archive coverage
ardumont renamed T2023: Re-implement gnu loader with package loader from Re-implement gnu loader with base loader to Re-implement gnu loader with package loader.
Oct 1 2019, 1:18 PM · Origin-GNU, Archive coverage
ardumont triaged T2024: Re-implement deposit loader with package loader mechanism as Normal priority.
Oct 1 2019, 1:18 PM · SWORD deposit, Archive coverage
ardumont changed the status of T2023: Re-implement gnu loader with package loader from Open to Work in Progress.
Oct 1 2019, 1:14 PM · Origin-GNU, Archive coverage
ardumont triaged T2022: Re-implement npm loader with base loader as Normal priority.
Oct 1 2019, 1:12 PM · Origin-npm, Archive coverage
ardumont triaged T2021: Re-implement pypi loader with package loader as Normal priority.
Oct 1 2019, 1:11 PM · Origin-Pypi, Archive coverage

Sep 18 2019

zack updated the task description for T775: Ingest Adullact forge.
Sep 18 2019, 2:24 PM · Archive coverage, FusionForge Forge
zack added a subtask for T775: Ingest Adullact forge: T778: FusionForge lister.
Sep 18 2019, 11:15 AM · Archive coverage, FusionForge Forge
zack renamed T775: Ingest Adullact forge from Add Adullact forge to the tracked forges to Ingest Adullact forge.
Sep 18 2019, 11:13 AM · Archive coverage, FusionForge Forge