In addition to origin_intrinsic_metadata.
If both sources exist for a given origin, they will be merged by ElasticSearch
as usual.
Differential D8131
journal-client: Consume from origin_extrinsic_metadata topic vlorentz on Jul 19 2022, 10:52 AM. Authored by Tags None Subscribers None
Details
In addition to origin_intrinsic_metadata. If both sources exist for a given origin, they will be merged by ElasticSearch
Diff Detail
Event TimelineComment Actions Build is green Patch application report for D8131 (id=29370)Could not rebase; Attempt merge onto 132b3b1238... Updating 132b3b1..db0d35c Fast-forward swh/search/elasticsearch.py | 26 +++++----- swh/search/in_memory.py | 24 ++++----- swh/search/interface.py | 8 +-- swh/search/journal_client.py | 22 +++++++- swh/search/tests/test_cli.py | 42 +++++++++++---- swh/search/tests/test_journal_client.py | 9 ++-- swh/search/tests/test_search.py | 92 ++++++++++++++++----------------- swh/search/tests/test_translator.py | 20 +++---- swh/search/translator.py | 16 +++--- swh/search/utils.py | 14 ++--- 10 files changed, 158 insertions(+), 115 deletions(-) Changes applied before testcommit db0d35c96f02cdb22f3b7a033cb35da9322ed28e Author: Valentin Lorentz <vlorentz@softwareheritage.org> Date: Tue Jul 19 10:52:33 2022 +0200 journal-client: Consume from origin_extrinsic_metadata topic In addition to origin_intrinsic_metadata. If both sources exist for a given origin, they will be merged by ElasticSearch as usual. commit 19a825889cfeac4f9019dcffe121508cf7a41c51 Author: Valentin Lorentz <vlorentz@softwareheritage.org> Date: Tue Jul 19 10:24:57 2022 +0200 Rename "intrinsic_metadata" field to "jsonld" It will soon be used to store and query extrinsic metadata as well See https://jenkins.softwareheritage.org/job/DSEA/job/tests-on-diff/337/ for more details. |