Page MenuHomeSoftware Heritage
Feed Advanced Search

Jan 8 2023

gitlab-migration closed T3860: Document types/sources of object corruption as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:23 PM · Archive content, Documentation
gitlab-migration closed T3089: Remove the 'metadata' column of the 'revision' table, a subtask of T1258: Synthesize release objects for all upstream things that match the concept of a release, as Migrated.
Jan 8 2023, 10:22 PM · Archive content
gitlab-migration closed T3089: Remove the 'metadata' column of the 'revision' table as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · Storage manager, Archive content
gitlab-migration closed T2513: Copy metadata on revisions to the extrinsic metadata storage, a subtask of T3089: Remove the 'metadata' column of the 'revision' table, as Migrated.
Jan 8 2023, 10:22 PM · Storage manager, Archive content
gitlab-migration closed T958: googlecode import: Clean up googlecode origin's origin_visits as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:21 PM · SVN Loader, Origin-GoogleCode, Archive content
gitlab-migration closed T698: Migrate the content store to a new (internal) primary key scheme, a subtask of T835: Migrate away from using sha1s as foreign keys in the database, as Migrated.
Jan 8 2023, 10:21 PM · Archive content
gitlab-migration changed the status of T3728: Display snapshots with only releases (or a release as HEAD branch), a subtask of T3638: Make package loaders create releases objects instead of revisions, from Duplicate to Migrated.
Jan 8 2023, 10:03 PM · Package Loader, Data Model, Archive content
gitlab-migration changed the status of T3638: Make package loaders create releases objects instead of revisions, a subtask of T1258: Synthesize release objects for all upstream things that match the concept of a release, from Resolved to Migrated.
Jan 8 2023, 10:02 PM · Archive content
gitlab-migration changed the status of T3638: Make package loaders create releases objects instead of revisions from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:02 PM · Package Loader, Data Model, Archive content
gitlab-migration changed the status of T3636: Make the opam loader write extrinsic metadata, a subtask of T3638: Make package loaders create releases objects instead of revisions, from Resolved to Migrated.
Jan 8 2023, 10:02 PM · Package Loader, Data Model, Archive content
gitlab-migration changed the status of T1691: metadata indexer: investigate metadata entries with empty mappings, a subtask of T1549: Clean up entries in {origin_intrinsic,revision}_metadata with no metadata, from Resolved to Migrated.
Jan 8 2023, 9:59 PM · Archive content, Indexer
gitlab-migration changed the status of T1691: metadata indexer: investigate metadata entries with empty mappings from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:59 PM · Archive content, Indexer
gitlab-migration changed the status of T1549: Clean up entries in {origin_intrinsic,revision}_metadata with no metadata from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:58 PM · Archive content, Indexer
gitlab-migration changed the status of T1303: Web UI: empty repositories shown as 404 errors with "snapshot not found" message from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:58 PM · Archive content, Web app
gitlab-migration changed the status of T976: google import: Clean up wrong revisions from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Archive content, Mercurial loader
gitlab-migration changed the status of T970: mercurial loader: What to do in case of .hgtags? from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Archive content, Mercurial loader
gitlab-migration changed the status of T970: mercurial loader: What to do in case of .hgtags?, a subtask of T965: googlecode import: Analyze and fix errors, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Archive content, Mercurial loader
gitlab-migration changed the status of T965: googlecode import: Analyze and fix errors from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Archive content, Mercurial loader
gitlab-migration changed the status of T957: googlecode import: Check for origin clashes and fix if any from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Archive content, Mercurial loader
gitlab-migration changed the status of T956: googlecode import: Clean up visit wrongly targetting empty snapshot from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Archive content, Mercurial loader
gitlab-migration changed the status of T948: googlecode import: Loading failure on symbolic link edge cases, a subtask of T879: Reschedule googlecode svn origins from scratch, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T955: googlecode import: hglib.error.CommandError during loading from Wontfix to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Origin-GoogleCode, Archive content, Mercurial loader
gitlab-migration changed the status of T947: googlecode import: Some dumps are just empty repository from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T948: googlecode import: Loading failure on symbolic link edge cases from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T947: googlecode import: Some dumps are just empty repository, a subtask of T879: Reschedule googlecode svn origins from scratch, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T896: Clean up wrong origins, a subtask of T879: Reschedule googlecode svn origins from scratch, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T896: Clean up wrong origins from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T879: Reschedule googlecode svn origins from scratch from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T854: clean up bogus mimetype values in content_mimetype table, a subtask of T817: analyze bogus mimetype values in content_mimetype table, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Archive content, Indexer
gitlab-migration changed the status of T854: clean up bogus mimetype values in content_mimetype table from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Archive content, Indexer
gitlab-migration changed the status of T849: Fix bogus mimetype values detection in the mimetype indexer implementation, a subtask of T817: analyze bogus mimetype values in content_mimetype table, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Archive content, Indexer
gitlab-migration changed the status of T850: reschedule indexing of contents with bogus mimetype values, a subtask of T817: analyze bogus mimetype values in content_mimetype table, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Archive content, Indexer
gitlab-migration changed the status of T850: reschedule indexing of contents with bogus mimetype values from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Archive content, Indexer
gitlab-migration changed the status of T849: Fix bogus mimetype values detection in the mimetype indexer implementation from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Archive content, Indexer
gitlab-migration changed the status of T849: Fix bogus mimetype values detection in the mimetype indexer implementation, a subtask of T850: reschedule indexing of contents with bogus mimetype values, from Resolved to Migrated.
Jan 8 2023, 9:57 PM · Archive content, Indexer
gitlab-migration changed the status of T838: SQL storage: drop the entity tables from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Storage manager, Archive content
gitlab-migration changed the status of T830: Remove tables occurrence and occurrence_history from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Storage manager, Archive content
gitlab-migration changed the status of T829: Remove duplication between fetch_history and origin_visit from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Storage manager, Archive content
gitlab-migration changed the status of T817: analyze bogus mimetype values in content_mimetype table from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:57 PM · Archive content, Indexer
gitlab-migration closed T3660: Nodes with missing ancestors in SWH DAG / SWH-graph as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:03 PM · Archive content
gitlab-migration closed T3660: Nodes with missing ancestors in SWH DAG / SWH-graph, a subtask of T3656: Survey revisions/releases with partially loaded history, as Migrated.
Jan 8 2023, 5:03 PM · Archive content
gitlab-migration closed T3656: Survey revisions/releases with partially loaded history as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:03 PM · Archive content
gitlab-migration closed T3246: Document takedown request processing workflow as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:02 PM · Archive content
gitlab-migration closed T3113: Cold storage archive as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:02 PM · Roadmap 2021, Archive content, meta-task
gitlab-migration closed T2333: Use non-url identifiers for origin url attribute as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:01 PM · Archive content
gitlab-migration closed T2059: Generate (swh) releases from all git tags, a subtask of T1258: Synthesize release objects for all upstream things that match the concept of a release, as Migrated.
Jan 8 2023, 5:01 PM · Archive content
gitlab-migration closed T1817: À la recherche du content perdu as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:00 PM · Archive content
gitlab-migration closed T1260: Extend the release object model to allow synthetic objects, a subtask of T1258: Synthesize release objects for all upstream things that match the concept of a release, as Migrated.
Jan 8 2023, 5:00 PM · Archive content
gitlab-migration closed T1260: Extend the release object model to allow synthetic objects as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:00 PM · Archive content
gitlab-migration closed T1258: Synthesize release objects for all upstream things that match the concept of a release as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:00 PM · Archive content
gitlab-migration closed T1212: git loader: add an option to force re-download/ingest everything, a subtask of T1211: reingest missing early objects, as Migrated.
Jan 8 2023, 5:00 PM · Archive content
gitlab-migration closed T1211: reingest missing early objects as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:00 PM · Archive content
gitlab-migration closed T1159: hg loader: Schedule oneshot tasks for googlecode origin ingestion as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:59 PM · Archive content
gitlab-migration closed T1159: hg loader: Schedule oneshot tasks for googlecode origin ingestion, a subtask of T1158: hg loader: Clean up wrong snapshots/releases during hg loading of googlecode, as Migrated.
Jan 8 2023, 4:59 PM · Archive content
gitlab-migration closed T1156: Fix release targets of already loaded mercurial type origins as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:59 PM · Archive content
gitlab-migration closed T997: Debian loader sometimes thinks a package has been loaded when it has not, a subtask of T995: Investigate and fix snapshots with broken links, as Migrated.
Jan 8 2023, 4:59 PM · Archive content
gitlab-migration closed T996: Load git origins with missing revisions again, a subtask of T995: Investigate and fix snapshots with broken links, as Migrated.
Jan 8 2023, 4:59 PM · Archive content
gitlab-migration closed T995: Investigate and fix snapshots with broken links as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:59 PM · Archive content
gitlab-migration closed T994: origin_visit: distinguish "fetch date" and "injection date" as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:59 PM · Archive content
gitlab-migration closed T994: origin_visit: distinguish "fetch date" and "injection date", a subtask of T829: Remove duplication between fetch_history and origin_visit, as Migrated.
Jan 8 2023, 4:59 PM · Storage manager, Archive content
gitlab-migration closed T835: Migrate away from using sha1s as foreign keys in the database as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:59 PM · Archive content
gitlab-migration closed T846: Some objects from the original GitHub import have never actually been imported. as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:59 PM · Roadmap 2020, Restricted Project, Archive content
gitlab-migration closed T809: move contents larger than current injection limit to separate object storage as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:59 PM · Archive content
gitlab-migration closed T686: Fix bogus directory entry permissions in database as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:59 PM · Archive content, Restricted Project
gitlab-migration closed T75: Check integrity of directories, revisions, and releases, a subtask of T3860: Document types/sources of object corruption, as Migrated.
Jan 8 2023, 4:59 PM · Archive content, Documentation
gitlab-migration closed T75: Check integrity of directories, revisions, and releases as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:59 PM · Archive content, Restricted Project
gitlab-migration changed the status of T3090: Make loaders not rely on the 'metadata' column of the 'revision' table, a subtask of T3089: Remove the 'metadata' column of the 'revision' table, from Resolved to Migrated.
Jan 8 2023, 4:33 PM · Storage manager, Archive content
gitlab-migration changed the status of T2441: Update SWHID regexp used by Zenodo from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:30 PM · Archive content
gitlab-migration changed the status of T2148: Recreate save code now requests that failed when migrating loaders from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:29 PM · Archive content
gitlab-migration changed the status of T1257: Formalize the default branch convention for snapshots from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:25 PM · Archive content
gitlab-migration changed the status of T1213: Git loader: allow ignoring the contents of the archive when updating an origin, a subtask of T1211: reingest missing early objects, from Duplicate to Migrated.
Jan 8 2023, 4:25 PM · Archive content
gitlab-migration changed the status of T1158: hg loader: Clean up wrong snapshots/releases during hg loading of googlecode from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:25 PM · Archive content
gitlab-migration changed the status of T1158: hg loader: Clean up wrong snapshots/releases during hg loading of googlecode, a subtask of T1156: Fix release targets of already loaded mercurial type origins, from Resolved to Migrated.
Jan 8 2023, 4:25 PM · Archive content
gitlab-migration changed the status of T1155: Mercurial loader: release target is invalid, a subtask of T1156: Fix release targets of already loaded mercurial type origins, from Resolved to Migrated.
Jan 8 2023, 4:25 PM · Archive content
gitlab-migration changed the status of T998: Mercurial loader sometimes creates snapshots that point to revisions that haven't been loaded, a subtask of T995: Investigate and fix snapshots with broken links, from Resolved to Migrated.
Jan 8 2023, 4:24 PM · Archive content
gitlab-migration changed the status of T980: Identify and fix releases that are stored as revisions from Wontfix to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:24 PM · Archive content
gitlab-migration changed the status of T946: loader-svn: googlecode import: UnicodeDecodeError in user svn properties fails the loading, a subtask of T879: Reschedule googlecode svn origins from scratch, from Resolved to Migrated.
Jan 8 2023, 4:24 PM · Origin-GoogleCode, SVN Loader, Archive content
gitlab-migration changed the status of T827: Reinstall pg_logical after postgres 10 upgrade from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:23 PM · Archive content
gitlab-migration changed the status of T719: Get a better estimated object count for the archive from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:20 PM · Archive content
gitlab-migration changed the status of T714: Visits for the GNU injection don't contain all the occurrences. from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:20 PM · Archive content
gitlab-migration changed the status of T366: Refactor the person table, a subtask of T75: Check integrity of directories, revisions, and releases, from Resolved to Migrated.
Jan 8 2023, 4:18 PM · Archive content, Restricted Project

Oct 19 2022

gitlab-migration changed the status of T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3, a subtask of T3638: Make package loaders create releases objects instead of revisions, from Resolved to Migrated.
Oct 19 2022, 6:05 PM · Package Loader, Data Model, Archive content
gitlab-migration changed the status of T3745: production: Deploy package loader v1.1, deposit server v0.16, lister v2.3 from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:05 PM · System administration, Package Loader, Data Model, Archive content
gitlab-migration changed the status of T3722: staging: Deploy package loader v1.0, deposit server v0.16, lister v2.3 from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:05 PM · System administration, SWORD deposit, Package Loader, Data Model, Archive content
gitlab-migration changed the status of T3722: staging: Deploy package loader v1.0, deposit server v0.16, lister v2.3, a subtask of T3638: Make package loaders create releases objects instead of revisions, from Resolved to Migrated.
Oct 19 2022, 6:05 PM · Package Loader, Data Model, Archive content
gitlab-migration closed T2564: migrate existing revisions metadata extra_headers to actual extra_headers field, a subtask of T3089: Remove the 'metadata' column of the 'revision' table, as Migrated.
Oct 19 2022, 5:58 PM · Storage manager, Archive content
gitlab-migration changed the status of T1534: PostgreSQL replication issues between prado and somerset from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:55 PM · System administration, Archive content

Apr 11 2022

olasd added a comment to T3656: Survey revisions/releases with partially loaded history.

Looks like the number of affected revisions is fluctuating a bit:

Apr 11 2022, 4:10 PM · Archive content
bchauvet added a comment to T3660: Nodes with missing ancestors in SWH DAG / SWH-graph.
  • needs review against the list generated for T3656
Apr 11 2022, 11:54 AM · Archive content
bchauvet added a comment to T3656: Survey revisions/releases with partially loaded history.
  • quantify the “hole” problem which prevents us to do T3655 altogether
Apr 11 2022, 11:54 AM · Archive content

Feb 1 2022

vlorentz added a comment to T75: Check integrity of directories, revisions, and releases.

With some more heuristics, retrying failed origins, and looking at dumps on banco (great idea from @olasd), I was able to bring down the total number of unrecoverable objects to 95k:

Feb 1 2022, 9:43 AM · Archive content, Restricted Project

Jan 31 2022

vlorentz added a comment to T3860: Document types/sources of object corruption.

got a list of weirdness types here: https://github.com/dulwich/dulwich/pull/927 and https://github.com/dulwich/dulwich/issues/931

Jan 31 2022, 10:49 AM · Archive content, Documentation

Jan 18 2022

vlorentz added a parent task for T75: Check integrity of directories, revisions, and releases: T3860: Document types/sources of object corruption.
Jan 18 2022, 12:44 PM · Archive content, Restricted Project
vlorentz added a subtask for T3860: Document types/sources of object corruption: T75: Check integrity of directories, revisions, and releases.
Jan 18 2022, 12:44 PM · Archive content, Documentation
vlorentz triaged T3860: Document types/sources of object corruption as High priority.
Jan 18 2022, 12:44 PM · Archive content, Documentation

Dec 13 2021

ardumont moved T3722: staging: Deploy package loader v1.0, deposit server v0.16, lister v2.3 from Backlog to Deployed on the SWORD deposit board.
Dec 13 2021, 11:27 AM · System administration, SWORD deposit, Package Loader, Data Model, Archive content

Nov 26 2021

vlorentz added a comment to T3638: Make package loaders create releases objects instead of revisions.

Copy of an email I sent on 2021-11-17:

Nov 26 2021, 4:02 PM · Package Loader, Data Model, Archive content

Nov 22 2021

vlorentz closed T3636: Make the opam loader write extrinsic metadata, a subtask of T3638: Make package loaders create releases objects instead of revisions, as Resolved.
Nov 22 2021, 2:44 PM · Package Loader, Data Model, Archive content
vlorentz closed T3638: Make package loaders create releases objects instead of revisions, a subtask of T1258: Synthesize release objects for all upstream things that match the concept of a release, as Resolved.
Nov 22 2021, 2:44 PM · Archive content
vlorentz closed T3638: Make package loaders create releases objects instead of revisions as Resolved.
Nov 22 2021, 2:43 PM · Package Loader, Data Model, Archive content