Page MenuHomeSoftware Heritage
Create Task
Maniphest T3090

Make loaders not rely on the 'metadata' column of the 'revision' table
Closed, MigratedEdits Locked
Actions

Description

They should use ExtId instead.

(They already write the metadata that needs to be archived to raw_extrinsic_metadata)

The plan:

  • T3141 Make loaders pass ExtId objects between functions instead of "known_artifact"
  • T3142 Make loaders write to the ExtId storage
  • T3143 Migrate revision metadata to extid in the storage
  • T3140 Make loaders use ExtId to find what arteficts are already loaded, in addition to revision.metadata
  • T3139 Make loaders stop reading from the 'metadata' column of the 'revision' table
  • T3138 Make loaders stop writing in the 'metadata' column of the 'revision' table

Related Objects
Search...

Event Timeline

vlorentz triaged this task as Normal priority.Mar 5 2021, 12:29 PM
vlorentz created this task.
vlorentz added a subtask: T2849: Design and implement a mapping from "original VCS ids" to SWHIDs to help incremental loaders.
douardda closed subtask T2849: Design and implement a mapping from "original VCS ids" to SWHIDs to help incremental loaders as Resolved.Mar 11 2021, 2:55 PM
vlorentz updated the task description. (Show Details)Mar 16 2021, 12:27 PM
vlorentz updated the task description. (Show Details)
vlorentz updated the task description. (Show Details)
vlorentz updated the task description. (Show Details)Mar 16 2021, 12:33 PM
vlorentz updated the task description. (Show Details)Mar 16 2021, 5:53 PM
vlorentz closed this task as Resolved.Apr 15 2021, 3:15 PM
vlorentz closed subtask T3138: Make loaders stop writing in the 'metadata' column of the 'revision' table as Resolved.
vlorentz added a subtask: T2564: migrate existing revisions metadata extra_headers to actual extra_headers field.
vlorentz changed the status of subtask T2564: migrate existing revisions metadata extra_headers to actual extra_headers field from Open to Work in Progress.Apr 28 2021, 12:43 PM
vlorentz changed the status of subtask T2564: migrate existing revisions metadata extra_headers to actual extra_headers field from Work in Progress to Open.May 26 2021, 11:26 AM
gitlab-migration closed subtask T2564: migrate existing revisions metadata extra_headers to actual extra_headers field as Migrated.Oct 19 2022, 5:57 PM
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 4:32 PM
gitlab-migration claimed this task.
gitlab-migration changed the status of subtask T2849: Design and implement a mapping from "original VCS ids" to SWHIDs to help incremental loaders from Resolved to Migrated.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

gitlab-migration changed the status of subtask T3138: Make loaders stop writing in the 'metadata' column of the 'revision' table from Resolved to Migrated.Jan 8 2023, 4:33 PM
About · Developer information · Legal