Page MenuHomeSoftware Heritage
Create Task
Maniphest T4315

[provenance] Fallback to swh-storage if a revision or its parent is not found in swh-graph
Closed, MigratedEdits Locked
Actions

Description

Only one archive storage is requested to resolve revision or revision parents.

If the default backend is the graph, it's not sure it's up to date so the revision resolution could not match the reality of the archive.

To solve that, if a revision is not found in the graph, the search should also be done in swh-storage

Revisions and Commits

rDPROV Provenance database
D7985rDPROVf5ed9de87b39 Improve origin layer logs
D7985rDPROVb69c0f7689f0 Add a new multiplexed archive type
D7985rDPROVd45f066a8c51 Declare the missing swh-graph dependency

Related Objects

Event Timeline

vsellier renamed this task from [provenance] Fallback to swh-storage if a revision is not found in swh-graph to [provenance] Fallback to swh-storage if a revision or its parent is not found in swh-graph.Jun 8 2022, 2:16 PM
vsellier triaged this task as Normal priority.
vsellier created this task.
vsellier added a revision: D7985: [provenance] Implement a naive archive multiplexer.Jun 14 2022, 12:23 PM
vsellier added a commit: rDPROVd45f066a8c51: Declare the missing swh-graph dependency.Jun 16 2022, 10:31 AM
vsellier added a commit: rDPROVf5ed9de87b39: Improve origin layer logs.
vsellier added a commit: rDPROVb69c0f7689f0: Add a new multiplexed archive type.
vsellier mentioned this in rDPROV12c45c828f2a: Don't stop the ingestion if an error occurs in one of the archive backend.
vsellier closed this task as Resolved.Jun 17 2022, 5:03 PM
vsellier claimed this task.

A dozen of clients running in the provenance-client01 are using the multiplexer configuration.
It seems to work correctly

gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 4:37 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal