Page MenuHomeSoftware Heritage

Archive coverageFolder
ActivePublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

stuff related to extend the coverage of the Software Heritage archive

Recent Activity

Today

zack raised the priority of T2400: ingest Ubuntu from Normal to High.
Wed, Dec 1, 12:39 PM · Archive coverage
borisbaldassari updated the task description for T1724: Maven Central repository support.
Wed, Dec 1, 10:35 AM · GSoC 2019, Archive coverage
ardumont updated the task description for T1724: Maven Central repository support.
Wed, Dec 1, 10:32 AM · GSoC 2019, Archive coverage

Mon, Nov 29

stsp added a revision to T3691: Implement CVS loader: D6708: fix expansion of multiple RCS keywords on a line via rsync.
Mon, Nov 29, 7:11 PM · Loader-CVS, Archive coverage

Wed, Nov 24

stsp added a revision to T3691: Implement CVS loader: D6684: fix regular expression used for matching RCS keywords.
Wed, Nov 24, 12:30 PM · Loader-CVS, Archive coverage
stsp added a revision to T3691: Implement CVS loader: D6678: attempt to avoid content differences due to paths in keywords.
Wed, Nov 24, 12:30 PM · Loader-CVS, Archive coverage
stsp added a comment to T3691: Implement CVS loader.

D6684 addresses another keyword expansion issue found while testing conversion of CVS's own history.

Wed, Nov 24, 12:30 PM · Loader-CVS, Archive coverage
stsp added a comment to T3691: Implement CVS loader.

The above problem with the Header keyword can be worked around (at least for the GNU savannah site) with the patch in D6678.

Wed, Nov 24, 10:53 AM · Loader-CVS, Archive coverage

Tue, Nov 23

borisbaldassari added a comment to T1724: Maven Central repository support.

Hi there,

Tue, Nov 23, 9:21 AM · GSoC 2019, Archive coverage

Mon, Nov 22

ardumont renamed T3746: staging: Deploy maven indexer/lister/loader from staging: Deploy maven exporter/lister/loader to staging: Deploy maven indexer/lister/loader.
Mon, Nov 22, 2:38 PM · System administration, Archive coverage
ardumont triaged T3746: staging: Deploy maven indexer/lister/loader as Normal priority.
Mon, Nov 22, 12:01 PM · System administration, Archive coverage
ardumont updated the task description for T1724: Maven Central repository support.
Mon, Nov 22, 11:56 AM · GSoC 2019, Archive coverage
ardumont updated the task description for T1724: Maven Central repository support.
Mon, Nov 22, 11:56 AM · GSoC 2019, Archive coverage
ardumont renamed T1724: Maven Central repository support from Maven Central repository Lister to Maven Central repository support.
Mon, Nov 22, 11:54 AM · GSoC 2019, Archive coverage

Thu, Nov 18

ardumont moved T3374: Ingest sourceforge repositories (origins of type git, svn, hg) from code-review/monitoring to done on the System administration board.
Thu, Nov 18, 3:17 PM · System administration, Archive coverage, Origin-SourceForge
ardumont moved T3599: List and ingest heptapod instances from code-review/monitoring to done on the System administration board.
Thu, Nov 18, 3:17 PM · System administration, Archive coverage
ardumont closed T3717: Ingest opam instance https://coq.inria.fr/opam/released/ as Resolved.
Thu, Nov 18, 3:16 PM · System administration, Archive coverage, Opam
ardumont moved T3717: Ingest opam instance https://coq.inria.fr/opam/released/ from code-review/monitoring to deployed/landed on the System administration board.
Thu, Nov 18, 3:16 PM · System administration, Archive coverage, Opam

Wed, Nov 17

ardumont moved T3717: Ingest opam instance https://coq.inria.fr/opam/released/ from in-progress to code-review/monitoring on the System administration board.
Wed, Nov 17, 3:00 PM · System administration, Archive coverage, Opam
ardumont added a revision to T3717: Ingest opam instance https://coq.inria.fr/opam/released/: D6647: changelog: Reference the opam coq repository ingestion.
Wed, Nov 17, 2:08 PM · System administration, Archive coverage, Opam

Fri, Nov 12

stsp added a comment to T3691: Implement CVS loader.

Another problem with keyword expansion found during testing:

Fri, Nov 12, 11:41 AM · Loader-CVS, Archive coverage
stsp added a revision to T3691: Implement CVS loader: D6638: preserve empty lines in CVS log messages over pserver.
Fri, Nov 12, 11:38 AM · Loader-CVS, Archive coverage

Wed, Nov 10

ardumont added a comment to T3717: Ingest opam instance https://coq.inria.fr/opam/released/.

@ardumont For production, drop the / at the end of the url, in staging, it's duplicated...

Wed, Nov 10, 6:27 PM · System administration, Archive coverage, Opam
ardumont changed the status of T3717: Ingest opam instance https://coq.inria.fr/opam/released/ from Open to Work in Progress.
Wed, Nov 10, 6:27 PM · System administration, Archive coverage, Opam
ardumont added a project to T3717: Ingest opam instance https://coq.inria.fr/opam/released/: System administration.
Wed, Nov 10, 6:24 PM · System administration, Archive coverage, Opam
ardumont added a comment to T3717: Ingest opam instance https://coq.inria.fr/opam/released/.

This got added to the staging infrastructure which lead to some surprises.
This mostly got fixed in the commits ^.

Wed, Nov 10, 6:23 PM · System administration, Archive coverage, Opam
stsp added a comment to T3691: Implement CVS loader.
In T3691#73518, @stsp wrote:

There is another problem related to keywords: Some CVS-based projects use custom keywords, instead of the standard $Id$ keyword. This prevents wrong expansion of $Id$ when code is imported from one project to another. Usually the project's name will be used as the custom keyword name, such as $OpenBSD$ or $NetBSD$, instead of $Id$. At present, to expand keywords correctly in this case, we need to use the pserver access method to benefit from server-side keyword expansion. But we will end up with different hashes if rsync is used to import the same origin again. We might be able to auto-detect use of custom keywords if the rsync server allows access to the CVSROOT folder, but this is not always the case. If CVSROOT is hidden from rsync, the only reliable way to detect custom keywords would be a parameter that gets passed into the loader. We could, for example, allow passing the name of a custom keyword as a parameter embedded in the origin URL.

Wed, Nov 10, 1:12 PM · Loader-CVS, Archive coverage

Tue, Nov 9

stsp added a comment to T3691: Implement CVS loader.

As of D6623 the CVS loader is able to convert GNU dino correctly over both rsync and pserver access.

Tue, Nov 9, 1:30 PM · Loader-CVS, Archive coverage
stsp added a revision to T3691: Implement CVS loader: D6623: add CVS commit ID support to rlog.py.
Tue, Nov 9, 1:27 PM · Loader-CVS, Archive coverage

Mon, Nov 8

zack updated the task description for T3717: Ingest opam instance https://coq.inria.fr/opam/released/.
Mon, Nov 8, 2:41 PM · System administration, Archive coverage, Opam
zack added a project to T3717: Ingest opam instance https://coq.inria.fr/opam/released/: Archive coverage.
Mon, Nov 8, 2:41 PM · System administration, Archive coverage, Opam

Fri, Nov 5

stsp added a comment to T3691: Implement CVS loader.

Status update:

Fri, Nov 5, 2:31 PM · Loader-CVS, Archive coverage

Oct 31 2021

stsp added a revision to T3691: Implement CVS loader: D6593: handle Attic-only RCS files over CVS pserver.
Oct 31 2021, 11:32 PM · Loader-CVS, Archive coverage

Oct 30 2021

stsp added a revision to T3691: Implement CVS loader: D6590: add support for RCS keyword expansion over pserver protocol.
Oct 30 2021, 11:49 AM · Loader-CVS, Archive coverage

Oct 28 2021

ardumont closed T3667: Orchestrate origins scheduling according to scheduler metrics feedback, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, as Resolved.
Oct 28 2021, 5:13 PM · Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont closed T3667: Orchestrate origins scheduling according to scheduler metrics feedback as Resolved.
Oct 28 2021, 5:13 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont moved T3667: Orchestrate origins scheduling according to scheduler metrics feedback from in-progress to deployed/landed on the System administration board.
Oct 28 2021, 4:43 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont moved T3667: Orchestrate origins scheduling according to scheduler metrics feedback from Backlog to in-progress on the System administration board.
Oct 28 2021, 4:43 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont added a project to T3667: Orchestrate origins scheduling according to scheduler metrics feedback: System administration.
Oct 28 2021, 4:42 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont added a comment to T3667: Orchestrate origins scheduling according to scheduler metrics feedback.

Deployed in production.

Oct 28 2021, 4:42 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont changed the status of T3667: Orchestrate origins scheduling according to scheduler metrics feedback, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Open to Work in Progress.
Oct 28 2021, 4:34 PM · Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont changed the status of T3667: Orchestrate origins scheduling according to scheduler metrics feedback from Open to Work in Progress.

Deployed in staging.

Oct 28 2021, 4:34 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
olasd added a revision to T3667: Orchestrate origins scheduling according to scheduler metrics feedback: D6583: scheduler: Add service to schedule recurrent visits.
Oct 28 2021, 4:16 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont added a revision to T3667: Orchestrate origins scheduling according to scheduler metrics feedback: D6574: scheduler: Add schedule recurrent tasks service.
Oct 28 2021, 11:35 AM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities

Oct 27 2021

stsp added a revision to T3691: Implement CVS loader: D6566: test checkout of file lacking trailing \n over pserver protocol.
Oct 27 2021, 4:20 PM · Loader-CVS, Archive coverage
stsp added a revision to T3691: Implement CVS loader: D6559: cvsclient: handle additional responses sent by server.
Oct 27 2021, 3:55 PM · Loader-CVS, Archive coverage
stsp added a revision to T3691: Implement CVS loader: D6561: rlog: fix loading of CVS commits which have a commit ID.
Oct 27 2021, 3:55 PM · Loader-CVS, Archive coverage
stsp added a revision to T3691: Implement CVS loader: D6560: rlog: fix parsing of multiple file revisions.
Oct 27 2021, 3:55 PM · Loader-CVS, Archive coverage
ardumont added a revision to T3691: Implement CVS loader: D6558: cvsclient: handle files which lack a trailing newline.
Oct 27 2021, 12:48 PM · Loader-CVS, Archive coverage
stsp added a comment to T3691: Implement CVS loader.

Current CVS loader status update:

Oct 27 2021, 12:36 PM · Loader-CVS, Archive coverage