Page MenuHomeSoftware Heritage

Finish the indexer -> swh-search pipeline
Closed, ResolvedPublic

Description

I wrote D1959 and D2027 a year ago, they need to be rebased and merge so we can really use swh-search for the archive search in swh-web.

Related Objects

StatusAssignedTask
OpenNone
Work in Progressvlorentz
Openvlorentz
OpenNone
Resolvedvlorentz
Resolvedvlorentz
Resolvedolasd
Resolvedardumont
Duplicateolasd
Resolvedvsellier
Resolvedvlorentz
Resolvedvlorentz
Resolvedvlorentz
Resolvedvsellier
Resolvedvsellier
Resolvedvlorentz
Resolvedvsellier
Resolvedvsellier
Resolvedvlorentz
Resolvedvsellier
Resolvedardumont
Resolvedardumont
Resolvedvsellier
Resolvedvsellier
Resolvedvsellier
Resolvedvsellier
Resolvedvsellier
Resolvedvsellier
Resolvedanlambert
Resolvedvlorentz
Resolvedvsellier
Resolvedvsellier
Resolvedvsellier

Event Timeline

vlorentz triaged this task as Normal priority.Sep 14 2020, 5:39 PM
vlorentz created this task.
vlorentz edited projects, added Journal; removed Storage manager.

this a description of the pipeline to clarify the interaction between the components (source: P883) :

PS1: currently, the search.journalclien's code is only listening origin and origin_visit topics, but it seems the everything is almost ready for intinsic_metadata
PS2: The swh.journal.indexed.origin_intrinsic topic name is the one @vlorentz has suggested in T2780

vlorentz changed the task status from Open to Work in Progress.Feb 11 2021, 11:01 AM